Objectives

  1. End to end analysis using R
  2. Learn the caret package for ML
  3. Learn to present the case using R Notebooks

Read in the dataset

I stored the raw files on Github, so I used RCurl with Wehrley’s method that utilizes read.csv to the fullest. It’s one of the best ways I’ve found to read in data and also set data-types at the same time. He’s done a great job on that function. The dataset contains one ID variable, one response variable and ten predictor variables.

library(RCurl,quietly = T)
library(tidyverse,quietly = T)
library(ggplot2,quietly = T)
library(gridExtra,quietly = T)
library(Amelia,quietly = T)
library(beanplot,quietly = T)
library(caret,quietly = T)
library(stringr,quietly = T)
library(party, quietly = T)
# library(rattle, quietly = T)
readData <- function(path.name, file.name, column.types, missing.types) {
    gurl <- paste(path.name,file.name,sep="")
    download.file(gurl,file.name,method="curl",quiet = T)
    tbl_df(read.csv(file.name,colClasses=column.types,
             na.strings=missing.types))
}
Titanic.path <- "https://raw.githubusercontent.com/rsangole/Titanic/master/"
train.data.file <- "train.csv"
test.data.file <- "test.csv"
missing.types <- c("NA", "")
train.column.types <- c('integer',   # PassengerId
                        'factor',    # Survived
                        'factor',    # Pclass
                        'character', # Name
                        'factor',    # Sex
                        'numeric',   # Age
                        'integer',   # SibSp
                        'integer',   # Parch
                        'character', # Ticket
                        'numeric',   # Fare
                        'character', # Cabin
                        'factor'     # Embarked
)
test.column.types <- train.column.types[-2]     # # no Survived column in test.csv
train.raw <- readData(Titanic.path, train.data.file,train.column.types,missing.types)
test.raw <- readData(Titanic.path, test.data.file,test.column.types,missing.types)
prep_data <- function(D) {
    if (!is.null(D$Survived)) {
        D$Survived <- factor(D$Survived,
                             levels = c(1, 0),
                             labels = c('Survived', 'Dead'))
        }
    D$Pclass <- factor(D$Pclass,
                       levels = c(1, 2, 3),
                       labels = c('P1', 'P2', 'P3'))
    D$PassengerId <- NULL
    D
}
train.raw <- prep_data(train.raw)
test.raw <- prep_data(test.raw)
str(train.raw)
Classes ‘tbl_df’, ‘tbl’ and 'data.frame':   891 obs. of  11 variables:
 $ Survived: Factor w/ 2 levels "Survived","Dead": 2 1 1 1 2 2 2 2 1 1 ...
 $ Pclass  : Factor w/ 3 levels "P1","P2","P3": 3 1 3 1 3 3 1 3 3 2 ...
 $ Name    : chr  "Braund, Mr. Owen Harris" "Cumings, Mrs. John Bradley (Florence Briggs Thayer)" "Heikkinen, Miss. Laina" "Futrelle, Mrs. Jacques Heath (Lily May Peel)" ...
 $ Sex     : Factor w/ 2 levels "female","male": 2 1 1 1 2 2 2 2 1 1 ...
 $ Age     : num  22 38 26 35 35 NA 54 2 27 14 ...
 $ SibSp   : int  1 1 0 1 0 0 0 3 0 1 ...
 $ Parch   : int  0 0 0 0 0 0 0 1 2 0 ...
 $ Ticket  : chr  "A/5 21171" "PC 17599" "STON/O2. 3101282" "113803" ...
 $ Fare    : num  7.25 71.28 7.92 53.1 8.05 ...
 $ Cabin   : chr  NA "C85" NA "C123" ...
 $ Embarked: Factor w/ 3 levels "C","Q","S": 3 1 3 3 3 2 3 3 3 1 ...

Missing values analysis

Quick investigation of missing values can be done using the complete.cases(), and more thorough graphical summary can be done using Amelia. Overall, 79% of the observations have some missing data.

#Complete cases (percentages)
round(prop.table(table(complete.cases(train.raw))),2)

FALSE  TRUE 
 0.79  0.21 

Amelia lets us graphically investigate which variables have missing data. purr::map_xxx() gives this same information numerically in a succint fashion.

missmap(train.raw, main='Missing Values Analysis using Amelia ordered by % missing', col=c('red', 'gray'),legend = F,rank.order = T)

#Missing cases (numbers):
map_int(train.raw,~sum(is.na(.x)))
Survived   Pclass     Name      Sex      Age    SibSp    Parch   Ticket     Fare 
       0        0        0        0      177        0        0        0        0 
   Cabin Embarked 
     687        2 
#Missing cases (percentages):
round(map_dbl(train.raw,~sum(is.na(.x))/length(.x)),2)
Survived   Pclass     Name      Sex      Age    SibSp    Parch   Ticket     Fare 
    0.00     0.00     0.00     0.00     0.20     0.00     0.00     0.00     0.00 
   Cabin Embarked 
    0.77     0.00 

Cabin has a large number of missing values (77% missing). Imputing this variable may prove challenging or even useless. Age (19.9% missing) and Embarked (0.2%) missing are much more managable.


EDA

The first step in the analysis is to explore the data numerically and graphically. I always split up my EDA investigation as follows:

  • Target Variable
  • Predictor Variables
    • Univariate
    • Bivariate
    • Multivariate

This gives me a structured approach towards larger datasets. My professor at Northwestern taught me to always complete a thorough intimate numeric & graphical EDA on the data, no matter how large the data 1. Anscombe (1973) clearly shows the importance of graphical analyses.

Target Variable

Survived is the response variable. As we can see, a large majority of the passengers did not survive the accident. The response variable is a False/True boolean variable. Thus, the analysis techniques used later will be those appropriate for classification problems.

round(prop.table(table(train.raw$Survived)),2)

Survived     Dead 
    0.38     0.62 

Predictor Variables

Univariate & Bivariate

The first step is to look at every variable available. I prefer using the ggplot2 framework for all the visuals.

Continuous Variables

  • Age seems to have a bimodal distribution - very young children, and then directly young adults to mid-age persons. The 2nd mode is right skewed with no obvious outliers.

  • Fare certainly shows many outliers beyond the ~$200 level. A majority of the fares are <$50, which makes sense since a majority of the travelers are bound to be in the 3rd passenger class.

p1 <- ggplot(data=train.raw,aes(x=Age))+geom_histogram(bins = 40)
p2 <- ggplot(data=train.raw,aes(x=Fare))+geom_histogram(bins = 40)
grid.arrange(p1,p2)

As we can see, the median fare is $14.5, the mean is $32, but the max is $512. We’ll investigate winzorising this variable in the latter part. Perhaps a transformation will also help?

summary(train.raw$Fare)
   Min. 1st Qu.  Median    Mean 3rd Qu.    Max. 
   0.00    7.91   14.45   32.20   31.00  512.33 

Categorical Variables

A ggplot command is iterated over for the categorical variables.2

Key takeways for the categorical variables:

  1. Pclass: If you were traveling 1st class, you have the highest chance of survival. Could be indicative of preferential treatment to those who paid more, a less politically correct class-stratified society, as well as the fact that the 1st class passengers had cabins at the very top of the ship.
  2. Pclass: Persons traveling 3rd class had the highest fatality rate. 3rd class passengers had cabins deep in the ship. With the reasons give in (1), this could have contributed to the low survival rate.
  3. Sex: Males have a very high fatality rate. Seems like the ‘women and children’ first policy was followed during evacuation.
  4. SibSp & Parch: What’s interesting here is, for both these variables, at level 0, the fatality rate is higher. At levels 1+, the chances of survival are much better. Again, this could point to the ‘women and children’ policy being followed. (Or perhaps there weren’t as many families with children on board!)
  5. Embarked: Southampton has a higher fatality rate than Cherbourg or Queenstown. A cross-tabulation between Embarked and Pclass shows that 72% of the 3rd class passengers and 89% of the 2nd class passengers boarded at Southampton. This jives with the observation that 2nd and 3rd class passengers have higher fatality rates.
get_legend<-function(myggplot){
  tmp <- ggplot_gtable(ggplot_build(myggplot))
  leg <- which(sapply(tmp$grobs, function(x) x$name) == "guide-box")
  legend <- tmp$grobs[[leg]]
  return(legend)
}
p <- lapply(X = c('Pclass','Sex','SibSp','Parch','Embarked'),
            FUN = function(x) ggplot(data = train.raw)+
                aes_string(x=x,fill='Survived')+
                geom_bar(position="dodge")+
                theme(legend.position="none"))
legend <- get_legend(ggplot(data = train.raw,aes(x=Pclass,fill=Survived))+geom_bar())
grid.arrange(p[[1]],p[[2]],p[[3]],p[[4]],p[[5]],legend,layout_matrix =
                 cbind(c(1,2,3),c(4,5,NA),c(6,6,6)),widths=c(3,3,1))

# round(prop.table(table(train.raw$Embarked,train.raw$Pclass),margin = 2),2)

Multivariate Analyses

Grouped boxplots are a common method of comparing distributions grouped by categorical variables. I find beanplots to be excellent complementary plots to boxplots (and in some cases, even better). They’re a bit tricky to read at first - since they are so underutilized - but just through one plot, a wealth of information can be extracted.3

Here is a comparison of the same information between a boxplot and a beanplot. What can we infer from the bean plot better?

  1. The beanplot allows us to visualize the density function of the parameter, in this case: Age. Furthermore, the length of each beanline is cumulative to the number of datapoints that exist. Rightaway, we can tell that Pclass=3 has the most data in the set, with sparser data at Pclass=1.
  2. The mean values for 1st class is higher than that for 2nd and 3rd class. The distributions of deceased and survived for 1st class are fairly similar.
  3. For 2nd and 3rd class, the survived data shows a bimodal distribution. Bumps at the 0-10 age show that children were evacuated first. This is also the reason the mean values for survived is lower.
  4. For 2nd and 3rd class, the deceased data shows a fairly normal distribution.
  5. The individual measurements (represented by black lines) represent each observation and help identify outliers much more easily than a boxplot does.
ggplot(train.raw,aes(y=Age,x=Pclass))+geom_boxplot(aes(fill=Survived))+theme_bw()

beanplot(Age~Survived*Pclass,side='b',train.raw,col=list('yellow','orange'),
         border = c('yellow2','darkorange'),ll = 0.05,boxwex = .5,
         main='Passenger survival by pclass and Age',xlab='Passenger Class',ylab='Age')
legend('topright', fill = c('yellow','orange'), legend = c("Dead", "Survived"),bty = 'n',cex = .8)

A look into the SibSp and Parch variables shows something interesting. There are three regions one can identify:

  • The probability of survival is minimal for number of parents/children aboard > 3.
  • The probability of survival is minimal for number of siblings/spouses aboard > 3.
  • For SibSp<=3 and Parch<=3, there are better chances for survival.

The grouping by Pclass reveals that all the large families were 3rd class travelers. Worse access to help… lowest chance for survival.

These could be simple rules either hard coded during model building: something along the lines of: IF (SibSp>3 OR Parch >3) THEN prediction = 0, or some derived variables can be created.

ggplot(train.raw,aes(y=SibSp,x=Parch))+
    geom_jitter(aes(color=Survived,shape=Pclass))+
    theme_bw()+
    scale_shape(solid=F)+
    geom_vline(xintercept = 3,color='darkblue',lty=3)+
    geom_hline(yintercept = 3,color='darkblue',lty=3)


Data Preparation

Missing Values Imputation

Starting with the easier one first:

Embarked: The largest portion of the passengers embared at Southhampton. I’m replacing the NAs with the same. First, I create a new imputed training dataset.

summary(train.raw$Embarked)
   C    Q    S NA's 
 168   77  644    2 
train.imp <- train.raw
train.imp$Embarked[is.na(train.imp$Embarked)] <- 'S'

Names, Titles & Age:

The names have titles embedded in the strings. I can extract these using regex. Master, Miss, Mr and Mrs are the most popular - no surprise there, with lots of other titles. Here’s the distribution of the titles by age. These can be used to impute the missing age values.

train.imp$title <- str_extract(pattern = '[a-zA-Z]+(?=\\.)',string = train.imp$Name)
There were 21 warnings (use warnings() to see them)
ggplot(train.raw,aes(x=title,y=Age))+
    stat_summary(aes(y = Age,group=1), fun.y=median, colour="red", geom="point",group=1)+
    geom_jitter(shape=21,alpha=.6,col='blue')+
    theme_bw()+
    theme(axis.text.x = element_text(angle = 45, hjust = 1),legend.position="none")+
    labs(caption='Red points are median values')

Grouping similar titles together, I’ve kept a few titles - Officer, Royalty, Mr, Mrs and Miss.

train.imp$title <- as.character(train.imp$title)
Unknown or uninitialised column: 'title'.Error in `$<-.data.frame`(`*tmp*`, title, value = character(0)) : 
  replacement has 0 rows, data has 891
ggplot(train.imp,aes(x=title,y=Age))+
    geom_jitter(color='blue',shape=21,alpha=.7)+
    stat_summary(aes(y = Age,group=1), fun.y=median, colour="red", geom="point",group=1)+
    theme_bw()+
    theme(axis.text.x = element_text(angle = 45, hjust = 1))+
    labs(caption='Red points are median values')

Now for the missing Age values. I’m trying out two strategies to impute age, just for kicks. First, a regression tree using the rpart method. 5-repeat 10-fold cross validation across a tuning grid of 20 values of maxdepth. RMSE stablizes at a depth of 14, with a value of 12.2.

age.predictors <- train.imp %>%
    dplyr::select(-Survived,-Cabin,-Ticket,-Name) %>%
    filter(complete.cases(.))
set.seed(1234)
ctrl <- trainControl(method = "boot",
                     repeats = 5,
                     number = 200
                     )
rpartGrid <- data.frame(maxdepth = seq(4,20,2))
rpartFit <- train(Age~.,
                  data=age.predictors,
                  method='rpart2',
                  trControl = ctrl,
                  tuneGrid = rpartGrid
                  )
rpartFit
CART 

712 samples
  7 predictor

No pre-processing
Resampling: Bootstrapped (200 reps) 
Summary of sample sizes: 712, 712, 712, 712, 712, 712, ... 
Resampling results across tuning parameters:

  maxdepth  RMSE      Rsquared 
   4        11.60195  0.3639229
   6        11.39531  0.3874650
   8        11.35948  0.3929570
  10        11.39089  0.3911342
  12        11.40211  0.3906539
  14        11.40403  0.3905312
  16        11.40376  0.3905592
  18        11.40376  0.3905592
  20        11.40376  0.3905592

RMSE was used to select the optimal model using  the smallest value.
The final value used for the model was maxdepth = 8.
plot(rpartFit)

plot(rpartFit$finalModel,margin=0.02)
text(rpartFit$finalModel,cex=0.8)

Another way is to run a randomforest with a search over values of mtry using 5-repeat 10-fold cross validation. As we can see mtry=4 is the optimal value which results in the lowest RMSE of 11.4; much better than the rpart model.

set.seed(1234)
rfGrid <- data.frame(mtry=seq(1,6,1))
ctrl <- trainControl(method = "repeatedcv",
                     repeats = 5
                     )
rfFit <- train(Age~.,
                  data=age.predictors,
                  method='rf',
                  trControl = ctrl,
                  tuneGrid = rfGrid)
rfFit
Random Forest 

712 samples
  7 predictor

No pre-processing
Resampling: Cross-Validated (10 fold, repeated 5 times) 
Summary of sample sizes: 642, 640, 642, 641, 640, 639, ... 
Resampling results across tuning parameters:

  mtry  RMSE      Rsquared 
  1     12.20581  0.4094138
  2     11.11017  0.4360662
  3     10.86481  0.4435870
  4     10.85212  0.4410892
  5     10.91261  0.4352909
  6     11.00547  0.4276434

RMSE was used to select the optimal model using  the smallest value.
The final value used for the model was mtry = 4.
plot(rfFit)

I’m going to use the randomForest model. Using the predict.train() to predict values of age and plug them back into the imputed data. You can see the blue points which are the imputed values of Age. What I noticed is that for all the titles, the imputed Age value seems to be distributed fairly well, except Master. For Master, the three imputed are definitely outliers. I’m going to force these to the median Age.

missing.age <- train.imp %>% filter(is.na(Age))
age.predicted <- predict(rfFit, newdata = missing.age)
train.imp %>%
    mutate(AgeMissing = is.na(Age),
           Age = ifelse(AgeMissing,age.predicted,Age)) %>%
    ggplot(aes(x=title,y=Age))+
    stat_summary(aes(y = Age,group=1), fun.y=median, colour="red", geom="point",group=1)+
    geom_jitter(aes(y=Age,col=AgeMissing),shape=2)+
    theme_bw()+
    theme(axis.text.x = element_text(angle = 45, hjust = 1),legend.position="none")+
    labs(caption='Red points are median values')

train.imp$Age[is.na(train.imp$Age)] <- age.predicted
train.imp$Age[train.imp$title=='Master' & train.imp$Age > 20] <- median(train.imp$Age[train.imp$title=='Master'],na.rm = T)

Derived Variables

Child?: Trying out two engineered variables here - is the passenger a child or not? Using Age=18 as a threshold. And is s/he close enough to be considered a adult by chance? Those between 16 and 18 could be mistaken for not being children. (My way of incorporating a fudge factor in the decision process of ladies & children first.)

train.imp$child <- 0
train.imp$child[train.imp$Age<18] <- 1
train.imp$almostadult <- as.numeric(between(train.imp$Age,16,18))

Really young, or really old?: Really young ones and older folks would get priority perhaps. Creating two categorical binary variables for these conditions.

train.imp$Young <- ifelse(train.imp$Age<10,1,0)
train.imp$Seniors <- ifelse(train.imp$Age>60,1,0)

Family related: Let’s also create some variables that talk about family sizes. What’s the total family size – continous variable TotalFam. Is the person single, part of a couple or a large family? Three categorical variables for these.

train.imp$TotalFam <- train.imp$SibSp + train.imp$Parch + 1
train.imp$LargeParCh <- as.numeric(train.imp$Parch>=3)
train.imp$LargeSibSp <- as.numeric(train.imp$SibSp>=3)
train.imp$Single <- ifelse(train.imp$TotalFam==1,1,0)
train.imp$Couple <- ifelse(train.imp$TotalFam==2,1,0)
train.imp$Family <- ifelse(train.imp$TotalFam>4,1,0)
train.imp$Name <- NULL

Cabin related: Extracting the cabin alphabet and number from the cabin variable. Since the cabin numbers could be ordered from left to right or top to bottom on the boat, perhaps only the 1st digit is significant. Also, some folks have more than 1 cabin. Wonder if that’s important. Since lots of unknowns in the Cabin variable, all NA values are replaced by ‘U’. Refering to the deck diagram, the topmost decks are A and B, which are closest to the lifeboats. Perhaps that’s important too. Here, I create a bunch of categorical variables based off the original Cabin, and then remove it from the dataset.

train.imp$CabinMissing <- as.numeric(is.na(train.raw$Cabin))
train.imp$CabinCode <- map_chr(train.raw$Cabin,~str_split(string = .x,pattern = '')[[1]][1])
train.imp$CabinCode[is.na(train.imp$CabinCode)] <- 'U'
train.imp$CabinNum <- as.numeric(map_chr(train.raw$Cabin,~str_split(string = .x,pattern = '[a-zA-Z]')[[1]][2]))
train.imp$CabinNum <- map_int(train.imp$CabinNum, ~as.integer(str_split(.x,pattern = '',simplify = T)[1][1]))
train.imp$CabinNum[is.na(train.imp$CabinNum)] <- 0
train.imp$TopDeck <- ifelse(train.imp$CabinCode %in% c('A','B'),1,0)
train.imp$MidDeck <- ifelse(train.imp$CabinCode %in% c('C','D'),1,0)
train.imp$LowerDeck <- ifelse(train.imp$TopDeck==0 & train.imp$MidDeck ==0 ,1,0)
train.imp$NumberofCabins <- map_int(train.raw$Cabin,~str_split(string = .x,pattern = ' ')[[1]] %>% length)
train.imp$Cabin <- NULL

Ticket: Lastly, the ticket variable. I’m not sure what to make of it, so I’m keeping it for now, after cleaning it up a bit. A majority (80%) of the rows have unique (one) ticket. 14% rows have a duplicate ticket, perhaps indicating a family. A small number of rows have 3+ duplicates of the tickets.

train.imp$Ticket %>% table() %>% as.numeric() %>% table()
.
  1   2   3   4   5   6   7 
547  94  21  11   2   3   3 

There seems to be a bit of a pattern here. Tickets starting with 1 are mostly 1st class, those starting with 2 are 2nd class, and 3 - 3rd class. But, I feel it’s a very loose association.

train.imp %>% group_by(Pclass) %>% dplyr::select(Ticket,Pclass) %>% sample_n(5)

What I’m going to do is clean up the columns (remove special characters, spaces etc), then split the Ticket column into four: TicketChar, TicketNum,TicketNumLength, TicketNumStart. (Upon running the script a few times, I’ve decided to get rid of TicketNum, but I’m commenting the code for future ref). The TicketChar variable as this distribution:

train.imp %<>%
    mutate(
        Ticket = str_to_upper(Ticket) %>%
            str_replace_all(pattern = regex(pattern = '[.\\/]'),replacement = ''),
        TicketNum = str_extract(Ticket,pattern = regex('([0-9]){3,}')),
        TicketNumStart = map_int(TicketNum,~as.integer(str_split(.x,pattern = '',simplify = T)[1])),
        TicketNumLen = map_int(TicketNum,~dim(str_split(.x,pattern = '',simplify = T))[2]),
        TicketChar = str_extract(Ticket,pattern = regex('^[a-zA-Z/\\.]+')) 
        ) %>%
     mutate(
         TicketChar = map_chr(.x=TicketChar,
                              .f=~str_split(string=.x, pattern = '',simplify = T)[1])
         ) %>%     
    mutate(
        TicketChar = ifelse(is.na(TicketChar),'U',TicketChar),
        TicketNumStart = ifelse(is.na(TicketNumStart),0,TicketNumStart),
        TicketNumLen = ifelse(is.na(TicketNumLen),0,TicketNumLen),
    )
train.imp$Ticket <- NULL
train.imp$TicketNum <- NULL
table(train.imp$TicketChar,dnn ='TicketChar')
TicketChar
  A   C   F   L   P   S   U   W 
 29  47   7   4  65  65 661  13 
table(train.imp$TicketNumLen,dnn='TicketNumLen')
TicketNumLen
  1   3   4   5   6   7 
  6   7 165 246 423  44 
table(train.imp$TicketNumStart,dnn='TicketNumStart')
TicketNumStart
  0   1   2   3   4   5   6   7   8   9 
  6 231 230 365  15   9  14  15   3   3 

Winzoring Variables

The fare variable has one massive outlier. Winzorising this variable using the 95th percentile value as the cutoff.

# ggplot(train.imp,aes(x=Fare,fill=Pclass))+geom_histogram()+facet_grid(Pclass~.)
# quantile(train.imp$Fare[train.imp$Pclass=='P1'],probs = c(.1,.25,.5,.75,.95))
# train.imp$Fare[train.imp$Fare>232] <- 232

Final Data Review

The dataset is now prepared for modeling. Here’s a quick review of the data so far. 29 variables in total.

train.imp %>% glimpse()
Observations: 891
Variables: 29
$ Survived       <fctr> Dead, Survived, Survived, Survived, Dead, Dead, Dead, D...
$ Pclass         <fctr> P3, P1, P3, P1, P3, P3, P1, P3, P3, P2, P3, P1, P3, P3,...
$ Sex            <fctr> male, female, female, female, male, male, male, male, f...
$ Age            <dbl> 22.00000, 38.00000, 26.00000, 35.00000, 35.00000, 35.651...
$ SibSp          <int> 1, 1, 0, 1, 0, 0, 0, 3, 0, 1, 1, 0, 0, 1, 0, 0, 4, 0, 1,...
$ Parch          <int> 0, 0, 0, 0, 0, 0, 0, 1, 2, 0, 1, 0, 0, 5, 0, 0, 1, 0, 0,...
$ Fare           <dbl> 7.2500, 71.2833, 7.9250, 53.1000, 8.0500, 8.4583, 51.862...
$ Embarked       <fctr> S, C, S, S, S, Q, S, S, S, C, S, S, S, S, S, S, Q, S, S...
$ title          <fctr> Mr, Mrs, Miss, Mrs, Mr, Mr, Mr, Master, Mrs, Mrs, Miss,...
$ child          <dbl> 0, 0, 0, 0, 0, 0, 0, 1, 0, 1, 1, 0, 0, 0, 1, 0, 1, 0, 0,...
$ almostadult    <dbl> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,...
$ Young          <dbl> 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 1, 0, 0, 0, 0, 0, 1, 0, 0,...
$ Seniors        <dbl> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,...
$ TotalFam       <dbl> 2, 2, 1, 2, 1, 1, 1, 5, 3, 2, 3, 1, 1, 7, 1, 1, 6, 1, 2,...
$ LargeParCh     <dbl> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0,...
$ LargeSibSp     <dbl> 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0,...
$ Single         <dbl> 0, 0, 1, 0, 1, 1, 1, 0, 0, 0, 0, 1, 1, 0, 1, 1, 0, 1, 0,...
$ Couple         <dbl> 1, 1, 0, 1, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 1,...
$ Family         <dbl> 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 1, 0, 0, 1, 0, 0,...
$ CabinMissing   <dbl> 1, 0, 1, 0, 1, 1, 0, 1, 1, 1, 0, 0, 1, 1, 1, 1, 1, 1, 1,...
$ CabinCode      <chr> "U", "C", "U", "C", "U", "U", "E", "U", "U", "U", "G", "...
$ CabinNum       <dbl> 0, 8, 0, 1, 0, 0, 4, 0, 0, 0, 6, 1, 0, 0, 0, 0, 0, 0, 0,...
$ TopDeck        <dbl> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,...
$ MidDeck        <dbl> 0, 1, 0, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0,...
$ LowerDeck      <dbl> 1, 0, 1, 0, 1, 1, 1, 1, 1, 1, 1, 0, 1, 1, 1, 1, 1, 1, 1,...
$ NumberofCabins <int> 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,...
$ TicketNumStart <dbl> 2, 1, 3, 1, 3, 3, 1, 3, 3, 2, 9, 1, 2, 3, 3, 2, 3, 2, 3,...
$ TicketNumLen   <int> 5, 5, 7, 6, 6, 6, 5, 6, 6, 6, 4, 6, 4, 6, 6, 6, 6, 6, 6,...
$ TicketChar     <chr> "A", "P", "S", "U", "U", "U", "U", "U", "U", "U", "P", "...

Modeling

I’m experimenting with a few modeling techniques, mainly xgboost, gbm, and penalized models using glmnet. I’ve implemented all these models using caret which I find an absolutely indispensible toolkit to prep, build, tune and explore numerous models using very few lines of code.

For all models, I’m using a 5-repeat 10-fold cross validation technique on the training dataset. Thus, I have not split the training dataset further into test-train sets, given the small number of observations in the dataset.

Furthermore, given the 80:20 class-imbalance, I’m also trying out smote as an class balancing technique for a few models.

Tuning parameter searches (aka hypertuning) is performed using the tuneGrid parameter in the train() call. The best model is selected using the AUC of the ROC. Here are the models and a few intermediate results for each model. At the end, I’ve compared the performance of all the models together.

Extreme Gradient Boosting (xgboost - 5repeat-10fold-cv - smaller dataset)

ctrl <- trainControl(method = "repeatedcv",
                     repeats = 5,
                     verboseIter = T,
                     classProbs = TRUE,
                     summaryFunction = twoClassSummary
                     # sampling = 'smote'
                     )
set.seed(1)
xgbGrid <- expand.grid(
    nrounds=c(2,3,4,5,6,7),
    max_depth=c(2,3,4,5,6,7),
    eta=c(0.3,0.5),
    gamma=1,
    colsample_bytree=1,
    min_child_weight=1,
    subsample=1
)
df.smaller <- train.imp %>% dplyr::select(
    -almostadult, -LargeParCh, - LargeSibSp,-CabinMissing,-TopDeck,-MidDeck,-LowerDeck,-NumberofCabins
)
dumV <- dummyVars(formula = Survived~.,data = df.smaller)
Dtrain <- predict(dumV,df.smaller)
variable 'Survived' is not a factor
xgbsmallFit <- train(
    x=Dtrain,
    y=train.imp$Survived,
    method = 'xgbTree',
    trControl = ctrl,
    # metric = "Kappa",
    tuneGrid = xgbGrid,
    verbose = TRUE
)
The metric "Accuracy" was not in the result set. ROC will be used instead.
+ Fold01.Rep1: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep1: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep1: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep1: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep1: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep1: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep1: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep1: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep1: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep1: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep1: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep1: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep1: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep1: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep1: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep1: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep1: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep1: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep1: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep1: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep1: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep1: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep1: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep1: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep1: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep1: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep1: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep1: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep1: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep1: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep1: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep1: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep1: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep1: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep1: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep1: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep1: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep1: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep1: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep1: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep1: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep1: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep1: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep1: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep1: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep1: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep1: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep1: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep1: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep1: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep1: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep1: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep1: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep1: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep1: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep1: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep1: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep1: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep1: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep1: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep1: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep1: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep1: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep1: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep1: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep1: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep1: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep1: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep1: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep1: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep1: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep1: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep1: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep1: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep1: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep1: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep1: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep1: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep1: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep1: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep1: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep1: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep1: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep1: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep1: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep1: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep1: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep1: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep1: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep1: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep1: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep1: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep1: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep1: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep1: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep1: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep1: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep1: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep1: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep1: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep1: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep1: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep1: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep1: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep1: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep1: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep1: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep1: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep1: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep1: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep1: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep1: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep1: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep1: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep1: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep1: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep1: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep1: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep1: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep1: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep1: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep1: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep1: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep1: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep1: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep1: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep1: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep1: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep1: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep1: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep1: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep1: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep1: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep1: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep1: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep1: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep1: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep1: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep1: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep1: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep1: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep1: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep1: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep1: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep1: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep1: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep1: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep1: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep1: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep1: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep1: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep1: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep1: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep1: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep1: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep1: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep1: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep1: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep1: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep1: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep1: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep1: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep1: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep1: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep1: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep1: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep1: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep1: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep1: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep1: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep1: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep1: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep1: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep1: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep1: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep1: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep1: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep1: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep1: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep1: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep1: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep1: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep1: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep1: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep1: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep1: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep1: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep1: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep1: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep1: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep1: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep1: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep1: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep1: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep1: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep1: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep1: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep1: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep1: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep1: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep1: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep1: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep1: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep1: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep1: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep1: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep1: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep1: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep1: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep1: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep1: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep1: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep1: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep1: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep1: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep1: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep1: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep1: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep1: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep1: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep1: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep1: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep1: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep1: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep1: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep1: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep1: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep1: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep1: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep1: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep1: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep1: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep1: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep1: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep1: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep1: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep1: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep1: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep1: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep1: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep2: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep2: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep2: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep2: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep2: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep2: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep2: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep2: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep2: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep2: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep2: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep2: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep2: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep2: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep2: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep2: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep2: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep2: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep2: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep2: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep2: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep2: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep2: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep2: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep2: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep2: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep2: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep2: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep2: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep2: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep2: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep2: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep2: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep2: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep2: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep2: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep2: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep2: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep2: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep2: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep2: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep2: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep2: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep2: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep2: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep2: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep2: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep2: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep2: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep2: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep2: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep2: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep2: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep2: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep2: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep2: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep2: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep2: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep2: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep2: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep2: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep2: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep2: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep2: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep2: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep2: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep2: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep2: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep2: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep2: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep2: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep2: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep2: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep2: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep2: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep2: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep2: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep2: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep2: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep2: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep2: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep2: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep2: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep2: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep2: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep2: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep2: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep2: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep2: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep2: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep2: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep2: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep2: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep2: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep2: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep2: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep2: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep2: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep2: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep2: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep2: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep2: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep2: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep2: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep2: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep2: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep2: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep2: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep2: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep2: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep2: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep2: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep2: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep2: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep2: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep2: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep2: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep2: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep2: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep2: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep2: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep2: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep2: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep2: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep2: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep2: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep2: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep2: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep2: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep2: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep2: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep2: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep2: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep2: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep2: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep2: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep2: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep2: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep2: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep2: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep2: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep2: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep2: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep2: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep2: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep2: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep2: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep2: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep2: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep2: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep2: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep2: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep2: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep2: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep2: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep2: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep2: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep2: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep2: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep2: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep2: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep2: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep2: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep2: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep2: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep2: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep2: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep2: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep2: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep2: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep2: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep2: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep2: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep2: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep2: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep2: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep2: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep2: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep2: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep2: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep2: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep2: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep2: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep2: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep2: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep2: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep2: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep2: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep2: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep2: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep2: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep2: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep2: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep2: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep2: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep2: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep2: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep2: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep2: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep2: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep2: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep2: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep2: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep2: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep2: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep2: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep2: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep2: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep2: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep2: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep2: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep2: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep2: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep2: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep2: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep2: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep2: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep2: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep2: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep2: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep2: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep2: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep2: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep2: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep2: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep2: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep2: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep2: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep2: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep2: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep2: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep2: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep2: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep2: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep2: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep2: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep2: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep2: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep2: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep2: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep3: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep3: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep3: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep3: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep3: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep3: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep3: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep3: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep3: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep3: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep3: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep3: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep3: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep3: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep3: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep3: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep3: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep3: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep3: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep3: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep3: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep3: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep3: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep3: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep3: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep3: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep3: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep3: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep3: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep3: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep3: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep3: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep3: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep3: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep3: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep3: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep3: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep3: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep3: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep3: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep3: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep3: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep3: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep3: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep3: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep3: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep3: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep3: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep3: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep3: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep3: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep3: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep3: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep3: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep3: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep3: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep3: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep3: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep3: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep3: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep3: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep3: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep3: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep3: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep3: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep3: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep3: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep3: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep3: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep3: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep3: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep3: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep3: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep3: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep3: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep3: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep3: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep3: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep3: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep3: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep3: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep3: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep3: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep3: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep3: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep3: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep3: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep3: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep3: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep3: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep3: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep3: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep3: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep3: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep3: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep3: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep3: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep3: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep3: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep3: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep3: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep3: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep3: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep3: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep3: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep3: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep3: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep3: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep3: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep3: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep3: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep3: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep3: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep3: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep3: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep3: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep3: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep3: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep3: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep3: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep3: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep3: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep3: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep3: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep3: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep3: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep3: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep3: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep3: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep3: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep3: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep3: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep3: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep3: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep3: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep3: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep3: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep3: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep3: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep3: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep3: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep3: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep3: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep3: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep3: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep3: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep3: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep3: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep3: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep3: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep3: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep3: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep3: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep3: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep3: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep3: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep3: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep3: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep3: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep3: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep3: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep3: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep3: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep3: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep3: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep3: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep3: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep3: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep3: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep3: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep3: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep3: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep3: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep3: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep3: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep3: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep3: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep3: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep3: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep3: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep3: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep3: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep3: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep3: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep3: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep3: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep3: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep3: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep3: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep3: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep3: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep3: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep3: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep3: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep3: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep3: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep3: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep3: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep3: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep3: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep3: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep3: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep3: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep3: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep3: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep3: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep3: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep3: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep3: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep3: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep3: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep3: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep3: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep3: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep3: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep3: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep3: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep3: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep3: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep3: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep3: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep3: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep3: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep3: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep3: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep3: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep3: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep3: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep3: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep3: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep3: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep3: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep3: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep3: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep3: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep3: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep3: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep3: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep3: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep3: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep4: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep4: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep4: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep4: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep4: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep4: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep4: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep4: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep4: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep4: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep4: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep4: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep4: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep4: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep4: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep4: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep4: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep4: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep4: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep4: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep4: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep4: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep4: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep4: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep4: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep4: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep4: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep4: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep4: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep4: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep4: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep4: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep4: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep4: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep4: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep4: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep4: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep4: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep4: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep4: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep4: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep4: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep4: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep4: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep4: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep4: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep4: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep4: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep4: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep4: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep4: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep4: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep4: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep4: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep4: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep4: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep4: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep4: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep4: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep4: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep4: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep4: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep4: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep4: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep4: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep4: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep4: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep4: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep4: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep4: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep4: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep4: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep4: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep4: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep4: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep4: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep4: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep4: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep4: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep4: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep4: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep4: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep4: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep4: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep4: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep4: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep4: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep4: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep4: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep4: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep4: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep4: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep4: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep4: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep4: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep4: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep4: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep4: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep4: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep4: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep4: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep4: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep4: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep4: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep4: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep4: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep4: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep4: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep4: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep4: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep4: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep4: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep4: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep4: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep4: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep4: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep4: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep4: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep4: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep4: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep4: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep4: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep4: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep4: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep4: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep4: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep4: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep4: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep4: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep4: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep4: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep4: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep4: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep4: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep4: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep4: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep4: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep4: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep4: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep4: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep4: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep4: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep4: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep4: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep4: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep4: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep4: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep4: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep4: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep4: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep4: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep4: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep4: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep4: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep4: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep4: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep4: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep4: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep4: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep4: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep4: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep4: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep4: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep4: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep4: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep4: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep4: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep4: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep4: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep4: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep4: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep4: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep4: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep4: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep4: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep4: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep4: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep4: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep4: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep4: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep4: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep4: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep4: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep4: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep4: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep4: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep4: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep4: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep4: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep4: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep4: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep4: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep4: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep4: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep4: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep4: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep4: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep4: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep4: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep4: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep4: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep4: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep4: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep4: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep4: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep4: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep4: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep4: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep4: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep4: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep4: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep4: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep4: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep4: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep4: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep4: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep4: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep4: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep4: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep4: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep4: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep4: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep4: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep4: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep4: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep4: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep4: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep4: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep4: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep4: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep4: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep4: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep4: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep4: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep4: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep4: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep4: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep4: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep4: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep4: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep5: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep5: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep5: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep5: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep5: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep5: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep5: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep5: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep5: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep5: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep5: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep5: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep5: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep5: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep5: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep5: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep5: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep5: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep5: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep5: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep5: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep5: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep5: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep5: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep5: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep5: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep5: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep5: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep5: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep5: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep5: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep5: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep5: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep5: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep5: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep5: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep5: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep5: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep5: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep5: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep5: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep5: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep5: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep5: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep5: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep5: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep5: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep5: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep5: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep5: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep5: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep5: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep5: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep5: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep5: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep5: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep5: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep5: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep5: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep5: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep5: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep5: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep5: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep5: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep5: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep5: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep5: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep5: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep5: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep5: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep5: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep5: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep5: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep5: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep5: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep5: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep5: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep5: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep5: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep5: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep5: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep5: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep5: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep5: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep5: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep5: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep5: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep5: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep5: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep5: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep5: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep5: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep5: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep5: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep5: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep5: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep5: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep5: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep5: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep5: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep5: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep5: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep5: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep5: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep5: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep5: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep5: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep5: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep5: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep5: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep5: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep5: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep5: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep5: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep5: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep5: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep5: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep5: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep5: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep5: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep5: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep5: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep5: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep5: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep5: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep5: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep5: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep5: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep5: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep5: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep5: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep5: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep5: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep5: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep5: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep5: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep5: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep5: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep5: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep5: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep5: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep5: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep5: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep5: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep5: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep5: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep5: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep5: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep5: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep5: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep5: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep5: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep5: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep5: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep5: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep5: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep5: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep5: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep5: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep5: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep5: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep5: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep5: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep5: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep5: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep5: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep5: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep5: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep5: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep5: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep5: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep5: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep5: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep5: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep5: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep5: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep5: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep5: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep5: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep5: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep5: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep5: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep5: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep5: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep5: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep5: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep5: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep5: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep5: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep5: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep5: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep5: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep5: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep5: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep5: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep5: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep5: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep5: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep5: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep5: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep5: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep5: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep5: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep5: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep5: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep5: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep5: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep5: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep5: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep5: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep5: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep5: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep5: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep5: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep5: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep5: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep5: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep5: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep5: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep5: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep5: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep5: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep5: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep5: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep5: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep5: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep5: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep5: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep5: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep5: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep5: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep5: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep5: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep5: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep5: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep5: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep5: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep5: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep5: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep5: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
Aggregating results
Selecting tuning parameters
Fitting nrounds = 7, max_depth = 6, eta = 0.3, gamma = 1, colsample_bytree = 1, min_child_weight = 1, subsample = 1 on full training set
xgbsmallFit
eXtreme Gradient Boosting 

891 samples
 46 predictor
  2 classes: 'Survived', 'Dead' 

No pre-processing
Resampling: Cross-Validated (10 fold, repeated 5 times) 
Summary of sample sizes: 803, 802, 802, 802, 802, 802, ... 
Resampling results across tuning parameters:

  eta  max_depth  nrounds  ROC        Sens       Spec     
  0.3  2          2        0.8556884  0.6334118  0.8885387
  0.3  2          3        0.8654604  0.7113109  0.8703232
  0.3  2          4        0.8658020  0.7357983  0.8670505
  0.3  2          5        0.8695347  0.7258487  0.8754411
  0.3  2          6        0.8714643  0.7328908  0.8695960
  0.3  2          7        0.8716870  0.7345882  0.8783502
  0.3  3          2        0.8738259  0.7328571  0.8736094
  0.3  3          3        0.8791066  0.7479664  0.8742896
  0.3  3          4        0.8815696  0.7327899  0.8797576
  0.3  3          5        0.8813198  0.7328235  0.8797778
  0.3  3          6        0.8798315  0.7316471  0.8783367
  0.3  3          7        0.8790512  0.7310420  0.8812323
  0.3  4          2        0.8741956  0.7427731  0.8670101
  0.3  4          3        0.8772288  0.7310084  0.8775825
  0.3  4          4        0.8786753  0.7355798  0.8754007
  0.3  4          5        0.8788861  0.7327227  0.8761279
  0.3  4          6        0.8790510  0.7240000  0.8823098
  0.3  4          7        0.8769154  0.7240336  0.8852391
  0.3  5          2        0.8716965  0.7334622  0.8688283
  0.3  5          3        0.8759597  0.7246218  0.8779798
  0.3  5          4        0.8781951  0.7304370  0.8794209
  0.3  5          5        0.8794532  0.7386891  0.8797778
  0.3  5          6        0.8822038  0.7351597  0.8841684
  0.3  5          7        0.8810805  0.7340000  0.8874545
  0.3  6          2        0.8699083  0.7322353  0.8695623
  0.3  6          3        0.8738153  0.7345714  0.8761212
  0.3  6          4        0.8774569  0.7380672  0.8844848
  0.3  6          5        0.8810306  0.7404202  0.8867138
  0.3  6          6        0.8827578  0.7386555  0.8940135
  0.3  6          7        0.8864057  0.7439328  0.8925522
  0.3  7          2        0.8710295  0.7322689  0.8743367
  0.3  7          3        0.8752944  0.7246050  0.8870976
  0.3  7          4        0.8775796  0.7345042  0.8911044
  0.3  7          5        0.8794251  0.7357143  0.8932727
  0.3  7          6        0.8826893  0.7356975  0.8951111
  0.3  7          7        0.8828565  0.7357311  0.8940202
  0.5  2          2        0.8560680  0.6396975  0.8867205
  0.5  2          3        0.8630652  0.7305378  0.8732525
  0.5  2          4        0.8661822  0.7293445  0.8736162
  0.5  2          5        0.8691908  0.7369580  0.8736094
  0.5  2          6        0.8699279  0.7374790  0.8732593
  0.5  2          7        0.8726835  0.7392101  0.8783704
  0.5  3          2        0.8738371  0.7276471  0.8757576
  0.5  3          3        0.8769989  0.7398992  0.8754209
  0.5  3          4        0.8759045  0.7299832  0.8896633
  0.5  3          5        0.8758248  0.7264706  0.8904040
  0.5  3          6        0.8763401  0.7258824  0.8885724
  0.5  3          7        0.8749303  0.7269748  0.8914815
  0.5  4          2        0.8752624  0.7339328  0.8793939
  0.5  4          3        0.8783071  0.7223529  0.8834343
  0.5  4          4        0.8778806  0.7175462  0.8867205
  0.5  4          5        0.8768180  0.7246723  0.8896162
  0.5  4          6        0.8790449  0.7258319  0.8918114
  0.5  4          7        0.8792554  0.7275966  0.8921751
  0.5  5          2        0.8753236  0.7358151  0.8688418
  0.5  5          3        0.8756946  0.7241176  0.8805320
  0.5  5          4        0.8756227  0.7310924  0.8856431
  0.5  5          5        0.8779657  0.7293277  0.8878047
  0.5  5          6        0.8768584  0.7281176  0.8903502
  0.5  5          7        0.8762507  0.7205042  0.8932593
  0.5  6          2        0.8737666  0.7281176  0.8783098
  0.5  6          3        0.8783667  0.7291765  0.8881616
  0.5  6          4        0.8815405  0.7380840  0.8903838
  0.5  6          5        0.8822538  0.7304874  0.8911111
  0.5  6          6        0.8825551  0.7351765  0.8911111
  0.5  6          7        0.8818076  0.7311092  0.8918451
  0.5  7          2        0.8736610  0.7193782  0.8845118
  0.5  7          3        0.8764140  0.7246050  0.8881886
  0.5  7          4        0.8776900  0.7287395  0.8889091
  0.5  7          5        0.8781861  0.7263697  0.8925253
  0.5  7          6        0.8800166  0.7246050  0.8903569
  0.5  7          7        0.8790226  0.7217311  0.8921751

Tuning parameter 'gamma' was held constant at a value of 1
Tuning
 parameter 'min_child_weight' was held constant at a value of 1
Tuning
 parameter 'subsample' was held constant at a value of 1
ROC was used to select the optimal model using  the largest value.
The final values used for the model were nrounds = 7, max_depth = 6, eta =
 0.3, gamma = 1, colsample_bytree = 1, min_child_weight = 1 and subsample = 1.
plot(xgbsmallFit)

xgb.importance(feature_names = colnames(Dtrain),model = xgbsmallFit$finalModel) %>%
    xgb.ggplot.importance()

densityplot(xgbsmallFit,pch='|')

predict(xgbsmallFit,type = 'prob') -> train.Probs
histogram(~Survived+Dead,train.Probs)

Extreme Gradient Boosting (xgboost - 5repeat-10fold-cv)

ctrl <- trainControl(method = "repeatedcv",
                     repeats = 5,
                     verboseIter = T,
                     classProbs = TRUE,
                     summaryFunction = twoClassSummary
                     # sampling = 'smote'
                     )
set.seed(1)
xgbGrid <- expand.grid(
    nrounds=c(2,3,4,5,6,7),
    max_depth=c(2,3,4,5,6,7),
    eta=c(0.3,0.5),
    gamma=1,
    colsample_bytree=1,
    min_child_weight=1,
    subsample=1
)
dumV <- dummyVars(formula = Survived~.,data = train.imp)
Dtrain <- predict(dumV,train.imp)
variable 'Survived' is not a factor
xgbFit <- train(
    x=Dtrain,
    y=train.imp$Survived,
    method = 'xgbTree',
    trControl = ctrl,
    # metric = "Kappa",
    tuneGrid = xgbGrid,
    verbose = TRUE
)
The metric "Accuracy" was not in the result set. ROC will be used instead.
+ Fold01.Rep1: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep1: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep1: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep1: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep1: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep1: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep1: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep1: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep1: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep1: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep1: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep1: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep1: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep1: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep1: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep1: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep1: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep1: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep1: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep1: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep1: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep1: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep1: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep1: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep1: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep1: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep1: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep1: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep1: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep1: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep1: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep1: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep1: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep1: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep1: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep1: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep1: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep1: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep1: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep1: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep1: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep1: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep1: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep1: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep1: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep1: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep1: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep1: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep1: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep1: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep1: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep1: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep1: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep1: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep1: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep1: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep1: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep1: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep1: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep1: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep1: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep1: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep1: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep1: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep1: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep1: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep1: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep1: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep1: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep1: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep1: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep1: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep1: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep1: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep1: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep1: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep1: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep1: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep1: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep1: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep1: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep1: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep1: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep1: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep1: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep1: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep1: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep1: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep1: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep1: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep1: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep1: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep1: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep1: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep1: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep1: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep1: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep1: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep1: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep1: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep1: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep1: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep1: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep1: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep1: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep1: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep1: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep1: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep1: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep1: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep1: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep1: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep1: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep1: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep1: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep1: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep1: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep1: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep1: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep1: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep1: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep1: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep1: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep1: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep1: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep1: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep1: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep1: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep1: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep1: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep1: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep1: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep1: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep1: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep1: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep1: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep1: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep1: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep1: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep1: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep1: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep1: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep1: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep1: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep1: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep1: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep1: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep1: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep1: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep1: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep1: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep1: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep1: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep1: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep1: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep1: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep1: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep1: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep1: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep1: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep1: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep1: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep1: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep1: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep1: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep1: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep1: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep1: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep1: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep1: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep1: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep1: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep1: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep1: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep1: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep1: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep1: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep1: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep1: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep1: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep1: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep1: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep1: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep1: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep1: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep1: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep1: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep1: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep1: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep1: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep1: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep1: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep1: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep1: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep1: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep1: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep1: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep1: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep1: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep1: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep1: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep1: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep1: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep1: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep1: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep1: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep1: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep1: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep1: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep1: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep1: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep1: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep1: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep1: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep1: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep1: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep1: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep1: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep1: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep1: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep1: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep1: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep1: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep1: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep1: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep1: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep1: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep1: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep1: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep1: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep1: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep1: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep1: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep1: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep1: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep1: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep1: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep1: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep1: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep1: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep2: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep2: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep2: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep2: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep2: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep2: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep2: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep2: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep2: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep2: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep2: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep2: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep2: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep2: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep2: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep2: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep2: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep2: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep2: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep2: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep2: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep2: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep2: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep2: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep2: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep2: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep2: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep2: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep2: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep2: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep2: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep2: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep2: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep2: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep2: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep2: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep2: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep2: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep2: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep2: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep2: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep2: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep2: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep2: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep2: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep2: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep2: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep2: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep2: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep2: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep2: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep2: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep2: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep2: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep2: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep2: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep2: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep2: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep2: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep2: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep2: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep2: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep2: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep2: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep2: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep2: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep2: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep2: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep2: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep2: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep2: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep2: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep2: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep2: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep2: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep2: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep2: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep2: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep2: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep2: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep2: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep2: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep2: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep2: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep2: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep2: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep2: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep2: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep2: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep2: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep2: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep2: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep2: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep2: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep2: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep2: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep2: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep2: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep2: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep2: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep2: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep2: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep2: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep2: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep2: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep2: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep2: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep2: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep2: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep2: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep2: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep2: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep2: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep2: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep2: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep2: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep2: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep2: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep2: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep2: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep2: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep2: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep2: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep2: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep2: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep2: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep2: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep2: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep2: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep2: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep2: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep2: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep2: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep2: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep2: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep2: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep2: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep2: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep2: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep2: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep2: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep2: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep2: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep2: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep2: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep2: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep2: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep2: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep2: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep2: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep2: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep2: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep2: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep2: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep2: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep2: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep2: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep2: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep2: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep2: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep2: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep2: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep2: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep2: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep2: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep2: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep2: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep2: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep2: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep2: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep2: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep2: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep2: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep2: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep2: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep2: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep2: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep2: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep2: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep2: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep2: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep2: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep2: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep2: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep2: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep2: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep2: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep2: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep2: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep2: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep2: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep2: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep2: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep2: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep2: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep2: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep2: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep2: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep2: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep2: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep2: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep2: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep2: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep2: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep2: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep2: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep2: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep2: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep2: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep2: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep2: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep2: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep2: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep2: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep2: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep2: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep2: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep2: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep2: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep2: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep2: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep2: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep2: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep2: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep2: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep2: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep2: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep2: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep2: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep2: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep2: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep2: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep2: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep2: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep2: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep2: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep2: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep2: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep2: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep2: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep3: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep3: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep3: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep3: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep3: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep3: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep3: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep3: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep3: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep3: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep3: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep3: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep3: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep3: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep3: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep3: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep3: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep3: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep3: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep3: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep3: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep3: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep3: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep3: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep3: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep3: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep3: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep3: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep3: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep3: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep3: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep3: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep3: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep3: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep3: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep3: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep3: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep3: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep3: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep3: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep3: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep3: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep3: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep3: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep3: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep3: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep3: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep3: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep3: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep3: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep3: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep3: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep3: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep3: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep3: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep3: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep3: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep3: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep3: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep3: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep3: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep3: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep3: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep3: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep3: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep3: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep3: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep3: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep3: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep3: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep3: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep3: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep3: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep3: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep3: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep3: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep3: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep3: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep3: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep3: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep3: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep3: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep3: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep3: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep3: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep3: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep3: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep3: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep3: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep3: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep3: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep3: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep3: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep3: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep3: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep3: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep3: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep3: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep3: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep3: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep3: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep3: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep3: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep3: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep3: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep3: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep3: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep3: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep3: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep3: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep3: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep3: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep3: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep3: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep3: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep3: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep3: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep3: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep3: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep3: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep3: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep3: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep3: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep3: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep3: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep3: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep3: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep3: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep3: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep3: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep3: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep3: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep3: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep3: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep3: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep3: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep3: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep3: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep3: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep3: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep3: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep3: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep3: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep3: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep3: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep3: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep3: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep3: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep3: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep3: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep3: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep3: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep3: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep3: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep3: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep3: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep3: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep3: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep3: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep3: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep3: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep3: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep3: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep3: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep3: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep3: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep3: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep3: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep3: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep3: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep3: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep3: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep3: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep3: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep3: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep3: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep3: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep3: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep3: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep3: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep3: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep3: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep3: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep3: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep3: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep3: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep3: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep3: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep3: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep3: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep3: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep3: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep3: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep3: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep3: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep3: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep3: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep3: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep3: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep3: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep3: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep3: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep3: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep3: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep3: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep3: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep3: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep3: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep3: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep3: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep3: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep3: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep3: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep3: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep3: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep3: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep3: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep3: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep3: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep3: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep3: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep3: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep3: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep3: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep3: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep3: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep3: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep3: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep3: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep3: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep3: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep3: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep3: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep3: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep3: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep3: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep3: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep3: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep3: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep3: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep4: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep4: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep4: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep4: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep4: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep4: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep4: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep4: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep4: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep4: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep4: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep4: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep4: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep4: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep4: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep4: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep4: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep4: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep4: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep4: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep4: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep4: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep4: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep4: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep4: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep4: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep4: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep4: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep4: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep4: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep4: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep4: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep4: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep4: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep4: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep4: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep4: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep4: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep4: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep4: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep4: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep4: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep4: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep4: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep4: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep4: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep4: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep4: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep4: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep4: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep4: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep4: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep4: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep4: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep4: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep4: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep4: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep4: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep4: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep4: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep4: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep4: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep4: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep4: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep4: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep4: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep4: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep4: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep4: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep4: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep4: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep4: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep4: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep4: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep4: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep4: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep4: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep4: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep4: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep4: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep4: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep4: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep4: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep4: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep4: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep4: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep4: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep4: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep4: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep4: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep4: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep4: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep4: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep4: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep4: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep4: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep4: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep4: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep4: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep4: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep4: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep4: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep4: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep4: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep4: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep4: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep4: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep4: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep4: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep4: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep4: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep4: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep4: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep4: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep4: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep4: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep4: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep4: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep4: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep4: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep4: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep4: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep4: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep4: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep4: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep4: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep4: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep4: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep4: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep4: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep4: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep4: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep4: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep4: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep4: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep4: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep4: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep4: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep4: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep4: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep4: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep4: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep4: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep4: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep4: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep4: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep4: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep4: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep4: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep4: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep4: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep4: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep4: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep4: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep4: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep4: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep4: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep4: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep4: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep4: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep4: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep4: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep4: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep4: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep4: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep4: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep4: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep4: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep4: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep4: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep4: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep4: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep4: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep4: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep4: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep4: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep4: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep4: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep4: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep4: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep4: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep4: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep4: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep4: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep4: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep4: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep4: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep4: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep4: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep4: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep4: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep4: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep4: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep4: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep4: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep4: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep4: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep4: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep4: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep4: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep4: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep4: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep4: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep4: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep4: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep4: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep4: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep4: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep4: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep4: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep4: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep4: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep4: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep4: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep4: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep4: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep4: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep4: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep4: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep4: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep4: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep4: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep4: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep4: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep4: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep4: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep4: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep4: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep4: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep4: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep4: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep4: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep4: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep4: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep4: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep4: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep4: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep4: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep4: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep4: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep5: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep5: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep5: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep5: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep5: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep5: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep5: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep5: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep5: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep5: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep5: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep5: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep5: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep5: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep5: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep5: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep5: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep5: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep5: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep5: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep5: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep5: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep5: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep5: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep5: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep5: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep5: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep5: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep5: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep5: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep5: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep5: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep5: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep5: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep5: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep5: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep5: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep5: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep5: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep5: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep5: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep5: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep5: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep5: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep5: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep5: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep5: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep5: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep5: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep5: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep5: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep5: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep5: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep5: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep5: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep5: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep5: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep5: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep5: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep5: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep5: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep5: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep5: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep5: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep5: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep5: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep5: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep5: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep5: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep5: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep5: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep5: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep5: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep5: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep5: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep5: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep5: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep5: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep5: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep5: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep5: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep5: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep5: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep5: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep5: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep5: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep5: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep5: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep5: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep5: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep5: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep5: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep5: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep5: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep5: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep5: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep5: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep5: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep5: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep5: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep5: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep5: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep5: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep5: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep5: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep5: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep5: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep5: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep5: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep5: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep5: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep5: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep5: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep5: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep5: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep5: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep5: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep5: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep5: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep5: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep5: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep5: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep5: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep5: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep5: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep5: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep5: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep5: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep5: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep5: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep5: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep5: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep5: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep5: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep5: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep5: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep5: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep5: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep5: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep5: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep5: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep5: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep5: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep5: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep5: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep5: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep5: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep5: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep5: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep5: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep5: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep5: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep5: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep5: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep5: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep5: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep5: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep5: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep5: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep5: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep5: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep5: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep5: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep5: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep5: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep5: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep5: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep5: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep5: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep5: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep5: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep5: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep5: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep5: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep5: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep5: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep5: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep5: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep5: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep5: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep5: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep5: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep5: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep5: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep5: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep5: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep5: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep5: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep5: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep5: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep5: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep5: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep5: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep5: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep5: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep5: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep5: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep5: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep5: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep5: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep5: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep5: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep5: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep5: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep5: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep5: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep5: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep5: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep5: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep5: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep5: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep5: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep5: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep5: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep5: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep5: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep5: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep5: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep5: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep5: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep5: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep5: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep5: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep5: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep5: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep5: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep5: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep5: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep5: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep5: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep5: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep5: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep5: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep5: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep5: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep5: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep5: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep5: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep5: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep5: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
Aggregating results
Selecting tuning parameters
Fitting nrounds = 7, max_depth = 6, eta = 0.3, gamma = 1, colsample_bytree = 1, min_child_weight = 1, subsample = 1 on full training set
xgbFit
eXtreme Gradient Boosting 

891 samples
 54 predictor
  2 classes: 'Survived', 'Dead' 

No pre-processing
Resampling: Cross-Validated (10 fold, repeated 5 times) 
Summary of sample sizes: 803, 802, 802, 802, 802, 802, ... 
Resampling results across tuning parameters:

  eta  max_depth  nrounds  ROC        Sens       Spec     
  0.3  2          2        0.8556884  0.6334118  0.8885387
  0.3  2          3        0.8654604  0.7113109  0.8703232
  0.3  2          4        0.8658020  0.7357983  0.8670505
  0.3  2          5        0.8695347  0.7258487  0.8754411
  0.3  2          6        0.8714643  0.7328908  0.8695960
  0.3  2          7        0.8716870  0.7345882  0.8783502
  0.3  3          2        0.8738205  0.7328571  0.8736094
  0.3  3          3        0.8790318  0.7479664  0.8742896
  0.3  3          4        0.8813646  0.7327899  0.8797576
  0.3  3          5        0.8812652  0.7328235  0.8797778
  0.3  3          6        0.8796906  0.7310588  0.8783367
  0.3  3          7        0.8790495  0.7316303  0.8812323
  0.3  4          2        0.8745105  0.7433277  0.8677374
  0.3  4          3        0.8771905  0.7298319  0.8797643
  0.3  4          4        0.8787187  0.7332773  0.8775825
  0.3  4          5        0.8790181  0.7304370  0.8750303
  0.3  4          6        0.8790842  0.7228739  0.8812189
  0.3  4          7        0.8769342  0.7217479  0.8859663
  0.3  5          2        0.8717136  0.7317311  0.8695556
  0.3  5          3        0.8758990  0.7258151  0.8776162
  0.3  5          4        0.8781548  0.7252437  0.8845118
  0.3  5          5        0.8796261  0.7357311  0.8826936
  0.3  5          6        0.8816546  0.7393109  0.8852525
  0.3  5          7        0.8815950  0.7305546  0.8907205
  0.3  6          2        0.8694777  0.7275966  0.8695623
  0.3  6          3        0.8752217  0.7269580  0.8819461
  0.3  6          4        0.8773608  0.7287227  0.8866734
  0.3  6          5        0.8808008  0.7352101  0.8878047
  0.3  6          6        0.8830016  0.7368908  0.8892862
  0.3  6          7        0.8844197  0.7357311  0.8885455
  0.3  7          2        0.8705224  0.7292941  0.8754141
  0.3  7          3        0.8754485  0.7351261  0.8863300
  0.3  7          4        0.8774183  0.7315630  0.8907273
  0.3  7          5        0.8818218  0.7292773  0.8907138
  0.3  7          6        0.8830574  0.7357479  0.8943569
  0.3  7          7        0.8832995  0.7381176  0.8950976
  0.5  2          2        0.8560680  0.6396975  0.8867205
  0.5  2          3        0.8630652  0.7305378  0.8732525
  0.5  2          4        0.8661822  0.7293445  0.8736162
  0.5  2          5        0.8691908  0.7369580  0.8736094
  0.5  2          6        0.8699714  0.7374790  0.8732593
  0.5  2          7        0.8727434  0.7392101  0.8783704
  0.5  3          2        0.8738157  0.7276471  0.8757576
  0.5  3          3        0.8769012  0.7398992  0.8754209
  0.5  3          4        0.8758660  0.7299832  0.8900135
  0.5  3          5        0.8763921  0.7305882  0.8878451
  0.5  3          6        0.8762469  0.7282353  0.8907542
  0.5  3          7        0.8755114  0.7240504  0.8914815
  0.5  4          2        0.8751281  0.7321849  0.8801212
  0.5  4          3        0.8792547  0.7252773  0.8837980
  0.5  4          4        0.8799806  0.7164370  0.8896296
  0.5  4          5        0.8779293  0.7240504  0.8936296
  0.5  4          6        0.8797766  0.7216975  0.8929024
  0.5  4          7        0.8787912  0.7223025  0.8903636
  0.5  5          2        0.8758828  0.7334790  0.8706599
  0.5  5          3        0.8763630  0.7316975  0.8808956
  0.5  5          4        0.8769005  0.7283025  0.8863704
  0.5  5          5        0.8788660  0.7323193  0.8856296
  0.5  5          6        0.8767038  0.7265210  0.8860000
  0.5  5          7        0.8760563  0.7187899  0.8874613
  0.5  6          2        0.8727151  0.7217143  0.8779461
  0.5  6          3        0.8792132  0.7326891  0.8848889
  0.5  6          4        0.8798558  0.7374454  0.8896566
  0.5  6          5        0.8798366  0.7298824  0.8911111
  0.5  6          6        0.8803528  0.7280504  0.8940202
  0.5  6          7        0.8801587  0.7309244  0.8918182
  0.5  7          2        0.8738105  0.7235126  0.8830505
  0.5  7          3        0.8784446  0.7269916  0.8896431
  0.5  7          4        0.8774348  0.7310588  0.8929024
  0.5  7          5        0.8794113  0.7270252  0.8969158
  0.5  7          6        0.8800860  0.7263529  0.8954613
  0.5  7          7        0.8797610  0.7316134  0.8918114

Tuning parameter 'gamma' was held constant at a value of 1
Tuning
 parameter 'min_child_weight' was held constant at a value of 1
Tuning
 parameter 'subsample' was held constant at a value of 1
ROC was used to select the optimal model using  the largest value.
The final values used for the model were nrounds = 7, max_depth = 6, eta =
 0.3, gamma = 1, colsample_bytree = 1, min_child_weight = 1 and subsample = 1.
plot(xgbFit)

xgb.importance(feature_names = colnames(Dtrain),model = xgbFit$finalModel) %>%
    xgb.ggplot.importance()

densityplot(xgbFit,pch='|')

predict(xgbFit,type = 'prob') -> train.Probs
histogram(~Survived+Dead,train.Probs)

Extreme Gradient Boosting (xgboost - 5test-train split)

ctrl <- trainControl(method = 'LGOCV',
                     number = 50,
                     verboseIter = T,
                     classProbs = TRUE,
                     summaryFunction = twoClassSummary
                     # sampling = 'smote'
                     )
set.seed(1)
xgbGrid <- expand.grid(
    nrounds=c(2,3,4,5,6,7),
    max_depth=c(2,3,4,5,6,7),
    eta=c(0.3,0.5),
    gamma=1,
    colsample_bytree=1,
    min_child_weight=1,
    subsample=1
)
dumV <- dummyVars(formula = Survived~.,data = train.imp)
Dtrain <- predict(dumV,train.imp)
variable 'Survived' is not a factor
xgbFit.LGOCV <- train(
    x=Dtrain,
    y=train.imp$Survived,
    method = 'xgbTree',
    trControl = ctrl,
    # metric = "Kappa",
    tuneGrid = xgbGrid,
    verbose = TRUE
)
The metric "Accuracy" was not in the result set. ROC will be used instead.
+ Resample01: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample01: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample01: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample01: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample01: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample01: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample01: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample01: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample01: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample01: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample01: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample01: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample01: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample01: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample01: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample01: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample01: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample01: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample01: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample01: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample01: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample01: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample01: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample01: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample02: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample02: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample02: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample02: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample02: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample02: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample02: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample02: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample02: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample02: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample02: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample02: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample02: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample02: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample02: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample02: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample02: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample02: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample02: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample02: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample02: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample02: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample02: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample02: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample03: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample03: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample03: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample03: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample03: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample03: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample03: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample03: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample03: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample03: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample03: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample03: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample03: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample03: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample03: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample03: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample03: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample03: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample03: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample03: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample03: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample03: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample03: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample03: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample04: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample04: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample04: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample04: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample04: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample04: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample04: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample04: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample04: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample04: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample04: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample04: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample04: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample04: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample04: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample04: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample04: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample04: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample04: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample04: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample04: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample04: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample04: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample04: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample05: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample05: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample05: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample05: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample05: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample05: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample05: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample05: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample05: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample05: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample05: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample05: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample05: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample05: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample05: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample05: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample05: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample05: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample05: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample05: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample05: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample05: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample05: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample05: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample06: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample06: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample06: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample06: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample06: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample06: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample06: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample06: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample06: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample06: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample06: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample06: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample06: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample06: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample06: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample06: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample06: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample06: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample06: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample06: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample06: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample06: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample06: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample06: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample07: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample07: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample07: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample07: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample07: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample07: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample07: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample07: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample07: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample07: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample07: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample07: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample07: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample07: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample07: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample07: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample07: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample07: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample07: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample07: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample07: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample07: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample07: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample07: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample08: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample08: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample08: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample08: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample08: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample08: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample08: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample08: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample08: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample08: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample08: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample08: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample08: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample08: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample08: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample08: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample08: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample08: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample08: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample08: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample08: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample08: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample08: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample08: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample09: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample09: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample09: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample09: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample09: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample09: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample09: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample09: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample09: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample09: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample09: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample09: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample09: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample09: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample09: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample09: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample09: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample09: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample09: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample09: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample09: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample09: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample09: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample09: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample10: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample10: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample10: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample10: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample10: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample10: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample10: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample10: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample10: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample10: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample10: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample10: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample10: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample10: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample10: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample10: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample10: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample10: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample10: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample10: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample10: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample10: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample10: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample10: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample11: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample11: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample11: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample11: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample11: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample11: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample11: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample11: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample11: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample11: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample11: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample11: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample11: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample11: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample11: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample11: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample11: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample11: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample11: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample11: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample11: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample11: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample11: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample11: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample12: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample12: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample12: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample12: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample12: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample12: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample12: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample12: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample12: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample12: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample12: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample12: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample12: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample12: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample12: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample12: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample12: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample12: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample12: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample12: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample12: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample12: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample12: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample12: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample13: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample13: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample13: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample13: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample13: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample13: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample13: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample13: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample13: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample13: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample13: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample13: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample13: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample13: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample13: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample13: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample13: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample13: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample13: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample13: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample13: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample13: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample13: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample13: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample14: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample14: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample14: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample14: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample14: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample14: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample14: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample14: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample14: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample14: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample14: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample14: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample14: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample14: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample14: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample14: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample14: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample14: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample14: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample14: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample14: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample14: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample14: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample14: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample15: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample15: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample15: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample15: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample15: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample15: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample15: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample15: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample15: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample15: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample15: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample15: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample15: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample15: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample15: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample15: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample15: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample15: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample15: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample15: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample15: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample15: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample15: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample15: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample16: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample16: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample16: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample16: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample16: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample16: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample16: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample16: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample16: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample16: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample16: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample16: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample16: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample16: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample16: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample16: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample16: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample16: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample16: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample16: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample16: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample16: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample16: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample16: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample17: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample17: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample17: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample17: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample17: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample17: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample17: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample17: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample17: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample17: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample17: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample17: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample17: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample17: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample17: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample17: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample17: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample17: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample17: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample17: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample17: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample17: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample17: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample17: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample18: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample18: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample18: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample18: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample18: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample18: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample18: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample18: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample18: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample18: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample18: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample18: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample18: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample18: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample18: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample18: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample18: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample18: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample18: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample18: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample18: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample18: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample18: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample18: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample19: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample19: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample19: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample19: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample19: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample19: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample19: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample19: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample19: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample19: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample19: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample19: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample19: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample19: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample19: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample19: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample19: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample19: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample19: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample19: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample19: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample19: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample19: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample19: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample20: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample20: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample20: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample20: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample20: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample20: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample20: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample20: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample20: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample20: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample20: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample20: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample20: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample20: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample20: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample20: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample20: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample20: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample20: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample20: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample20: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample20: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample20: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample20: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample21: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample21: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample21: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample21: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample21: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample21: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample21: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample21: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample21: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample21: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample21: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample21: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample21: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample21: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample21: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample21: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample21: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample21: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample21: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample21: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample21: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample21: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample21: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample21: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample22: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample22: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample22: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample22: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample22: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample22: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample22: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample22: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample22: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample22: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample22: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample22: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample22: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample22: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample22: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample22: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample22: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample22: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample22: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample22: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample22: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample22: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample22: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample22: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample23: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample23: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample23: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample23: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample23: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample23: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample23: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample23: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample23: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample23: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample23: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample23: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample23: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample23: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample23: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample23: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample23: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample23: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample23: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample23: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample23: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample23: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample23: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample23: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample24: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample24: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample24: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample24: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample24: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample24: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample24: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample24: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample24: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample24: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample24: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample24: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample24: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample24: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample24: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample24: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample24: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample24: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample24: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample24: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample24: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample24: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample24: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample24: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample25: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample25: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample25: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample25: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample25: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample25: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample25: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample25: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample25: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample25: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample25: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample25: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample25: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample25: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample25: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample25: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample25: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample25: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample25: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample25: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample25: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample25: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample25: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample25: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample26: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample26: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample26: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample26: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample26: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample26: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample26: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample26: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample26: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample26: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample26: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample26: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample26: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample26: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample26: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample26: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample26: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample26: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample26: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample26: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample26: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample26: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample26: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample26: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample27: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample27: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample27: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample27: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample27: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample27: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample27: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample27: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample27: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample27: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample27: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample27: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample27: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample27: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample27: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample27: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample27: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample27: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample27: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample27: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample27: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample27: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample27: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample27: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample28: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample28: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample28: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample28: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample28: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample28: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample28: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample28: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample28: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample28: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample28: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample28: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample28: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample28: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample28: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample28: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample28: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample28: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample28: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample28: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample28: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample28: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample28: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample28: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample29: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample29: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample29: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample29: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample29: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample29: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample29: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample29: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample29: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample29: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample29: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample29: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample29: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample29: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample29: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample29: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample29: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample29: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample29: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample29: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample29: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample29: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample29: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample29: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample30: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample30: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample30: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample30: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample30: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample30: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample30: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample30: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample30: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample30: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample30: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample30: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample30: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample30: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample30: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample30: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample30: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample30: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample30: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample30: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample30: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample30: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample30: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample30: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample31: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample31: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample31: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample31: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample31: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample31: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample31: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample31: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample31: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample31: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample31: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample31: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample31: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample31: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample31: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample31: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample31: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample31: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample31: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample31: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample31: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample31: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample31: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample31: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample32: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample32: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample32: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample32: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample32: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample32: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample32: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample32: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample32: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample32: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample32: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample32: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample32: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample32: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample32: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample32: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample32: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample32: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample32: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample32: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample32: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample32: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample32: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample32: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample33: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample33: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample33: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample33: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample33: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample33: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample33: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample33: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample33: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample33: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample33: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample33: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample33: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample33: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample33: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample33: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample33: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample33: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample33: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample33: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample33: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample33: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample33: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample33: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample34: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample34: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample34: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample34: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample34: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample34: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample34: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample34: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample34: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample34: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample34: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample34: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample34: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample34: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample34: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample34: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample34: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample34: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample34: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample34: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample34: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample34: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample34: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample34: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample35: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample35: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample35: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample35: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample35: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample35: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample35: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample35: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample35: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample35: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample35: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample35: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample35: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample35: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample35: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample35: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample35: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample35: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample35: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample35: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample35: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample35: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample35: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample35: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample36: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample36: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample36: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample36: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample36: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample36: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample36: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample36: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample36: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample36: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample36: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample36: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample36: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample36: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample36: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample36: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample36: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample36: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample36: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample36: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample36: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample36: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample36: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample36: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample37: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample37: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample37: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample37: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample37: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample37: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample37: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample37: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample37: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample37: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample37: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample37: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample37: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample37: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample37: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample37: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample37: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample37: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample37: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample37: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample37: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample37: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample37: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample37: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample38: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample38: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample38: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample38: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample38: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample38: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample38: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample38: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample38: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample38: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample38: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample38: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample38: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample38: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample38: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample38: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample38: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample38: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample38: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample38: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample38: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample38: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample38: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample38: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample39: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample39: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample39: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample39: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample39: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample39: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample39: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample39: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample39: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample39: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample39: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample39: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample39: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample39: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample39: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample39: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample39: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample39: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample39: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample39: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample39: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample39: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample39: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample39: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample40: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample40: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample40: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample40: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample40: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample40: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample40: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample40: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample40: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample40: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample40: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample40: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample40: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample40: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample40: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample40: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample40: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample40: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample40: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample40: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample40: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample40: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample40: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample40: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample41: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample41: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample41: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample41: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample41: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample41: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample41: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample41: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample41: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample41: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample41: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample41: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample41: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample41: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample41: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample41: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample41: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample41: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample41: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample41: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample41: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample41: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample41: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample41: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample42: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample42: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample42: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample42: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample42: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample42: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample42: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample42: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample42: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample42: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample42: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample42: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample42: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample42: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample42: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample42: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample42: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample42: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample42: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample42: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample42: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample42: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample42: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample42: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample43: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample43: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample43: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample43: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample43: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample43: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample43: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample43: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample43: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample43: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample43: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample43: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample43: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample43: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample43: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample43: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample43: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample43: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample43: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample43: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample43: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample43: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample43: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample43: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample44: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample44: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample44: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample44: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample44: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample44: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample44: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample44: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample44: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample44: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample44: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample44: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample44: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample44: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample44: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample44: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample44: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample44: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample44: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample44: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample44: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample44: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample44: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample44: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample45: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample45: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample45: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample45: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample45: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample45: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample45: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample45: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample45: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample45: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample45: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample45: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample45: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample45: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample45: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample45: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample45: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample45: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample45: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample45: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample45: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample45: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample45: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample45: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample46: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample46: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample46: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample46: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample46: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample46: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample46: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample46: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample46: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample46: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample46: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample46: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample46: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample46: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample46: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample46: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample46: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample46: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample46: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample46: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample46: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample46: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample46: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample46: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample47: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample47: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample47: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample47: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample47: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample47: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample47: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample47: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample47: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample47: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample47: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample47: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample47: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample47: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample47: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample47: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample47: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample47: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample47: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample47: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample47: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample47: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample47: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample47: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample48: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample48: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample48: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample48: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample48: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample48: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample48: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample48: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample48: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample48: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample48: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample48: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample48: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample48: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample48: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample48: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample48: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample48: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample48: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample48: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample48: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample48: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample48: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample48: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample49: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample49: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample49: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample49: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample49: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample49: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample49: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample49: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample49: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample49: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample49: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample49: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample49: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample49: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample49: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample49: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample49: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample49: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample49: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample49: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample49: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample49: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample49: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample49: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample50: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample50: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample50: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample50: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample50: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample50: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample50: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample50: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample50: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample50: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample50: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample50: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample50: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample50: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample50: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample50: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample50: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample50: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample50: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample50: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample50: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample50: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Resample50: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Resample50: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
Aggregating results
Selecting tuning parameters
Fitting nrounds = 6, max_depth = 6, eta = 0.3, gamma = 1, colsample_bytree = 1, min_child_weight = 1, subsample = 1 on full training set
xgbFit.LGOCV
eXtreme Gradient Boosting 

891 samples
 53 predictor
  2 classes: 'Survived', 'Dead' 

No pre-processing
Resampling: Repeated Train/Test Splits Estimated (50 reps, 75%) 
Summary of sample sizes: 669, 669, 669, 669, 669, 669, ... 
Resampling results across tuning parameters:

  eta  max_depth  nrounds  ROC        Sens       Spec     
  0.3  2          2        0.8520850  0.6623529  0.8795620
  0.3  2          3        0.8604663  0.6901176  0.8767883
  0.3  2          4        0.8644860  0.7225882  0.8690511
  0.3  2          5        0.8668854  0.7188235  0.8715328
  0.3  2          6        0.8675526  0.7312941  0.8683212
  0.3  2          7        0.8686638  0.7244706  0.8699270
  0.3  3          2        0.8649901  0.7284706  0.8654015
  0.3  3          3        0.8703864  0.7345882  0.8651095
  0.3  3          4        0.8726595  0.7287059  0.8740146
  0.3  3          5        0.8751009  0.7348235  0.8718248
  0.3  3          6        0.8749558  0.7336471  0.8728467
  0.3  3          7        0.8746337  0.7312941  0.8750365
  0.3  4          2        0.8669678  0.7367059  0.8589781
  0.3  4          3        0.8706509  0.7282353  0.8696350
  0.3  4          4        0.8729266  0.7261176  0.8750365
  0.3  4          5        0.8752452  0.7324706  0.8731387
  0.3  4          6        0.8750691  0.7256471  0.8751825
  0.3  4          7        0.8749180  0.7254118  0.8769343
  0.3  5          2        0.8643761  0.7204706  0.8648175
  0.3  5          3        0.8690245  0.7228235  0.8678832
  0.3  5          4        0.8725839  0.7209412  0.8728467
  0.3  5          5        0.8738695  0.7207059  0.8753285
  0.3  5          6        0.8740215  0.7261176  0.8750365
  0.3  5          7        0.8748759  0.7221176  0.8804380
  0.3  6          2        0.8651207  0.7249412  0.8623358
  0.3  6          3        0.8700773  0.7195294  0.8706569
  0.3  6          4        0.8706561  0.7249412  0.8737226
  0.3  6          5        0.8747883  0.7263529  0.8725547
  0.3  6          6        0.8765693  0.7282353  0.8747445
  0.3  6          7        0.8763426  0.7263529  0.8792701
  0.3  7          2        0.8645762  0.7232941  0.8600000
  0.3  7          3        0.8698042  0.7237647  0.8718248
  0.3  7          4        0.8714453  0.7261176  0.8745985
  0.3  7          5        0.8736239  0.7289412  0.8781022
  0.3  7          6        0.8749987  0.7282353  0.8797080
  0.3  7          7        0.8763650  0.7277647  0.8818978
  0.5  2          2        0.8564156  0.6658824  0.8794161
  0.5  2          3        0.8625985  0.7120000  0.8684672
  0.5  2          4        0.8649206  0.7275294  0.8636496
  0.5  2          5        0.8681580  0.7296471  0.8654015
  0.5  2          6        0.8687978  0.7232941  0.8667153
  0.5  2          7        0.8699382  0.7171765  0.8722628
  0.5  3          2        0.8685307  0.7247059  0.8703650
  0.5  3          3        0.8717518  0.7277647  0.8694891
  0.5  3          4        0.8731404  0.7218824  0.8767883
  0.5  3          5        0.8726930  0.7129412  0.8820438
  0.5  3          6        0.8728278  0.7190588  0.8811679
  0.5  3          7        0.8734865  0.7202353  0.8827737
  0.5  4          2        0.8676591  0.7294118  0.8646715
  0.5  4          3        0.8718987  0.7197647  0.8759124
  0.5  4          4        0.8709841  0.7202353  0.8753285
  0.5  4          5        0.8709901  0.7195294  0.8792701
  0.5  4          6        0.8713242  0.7195294  0.8781022
  0.5  4          7        0.8717192  0.7225882  0.8811679
  0.5  5          2        0.8669815  0.7152941  0.8694891
  0.5  5          3        0.8718824  0.7155294  0.8750365
  0.5  5          4        0.8732769  0.7209412  0.8786861
  0.5  5          5        0.8747763  0.7183529  0.8821898
  0.5  5          6        0.8748802  0.7188235  0.8805839
  0.5  5          7        0.8744139  0.7242353  0.8797080
  0.5  6          2        0.8671687  0.7202353  0.8700730
  0.5  6          3        0.8718360  0.7192941  0.8756204
  0.5  6          4        0.8734650  0.7164706  0.8816058
  0.5  6          5        0.8738386  0.7228235  0.8814599
  0.5  6          6        0.8731095  0.7188235  0.8836496
  0.5  6          7        0.8732761  0.7261176  0.8824818
  0.5  7          2        0.8665393  0.7261176  0.8664234
  0.5  7          3        0.8709807  0.7265882  0.8750365
  0.5  7          4        0.8726621  0.7275294  0.8781022
  0.5  7          5        0.8721889  0.7320000  0.8783942
  0.5  7          6        0.8733568  0.7320000  0.8798540
  0.5  7          7        0.8729841  0.7348235  0.8804380

Tuning parameter 'gamma' was held constant at a value of 1
Tuning parameter
 'colsample_bytree' was held constant at a value of 1
Tuning parameter 'min_child_weight'
 was held constant at a value of 1
Tuning parameter 'subsample' was held constant at a value of 1
ROC was used to select the optimal model using  the largest value.
The final values used for the model were nrounds = 6, max_depth = 6, eta = 0.3, gamma =
 1, colsample_bytree = 1, min_child_weight = 1 and subsample = 1.
plot(xgbFit.LGOCV)

xgb.importance(feature_names = colnames(Dtrain),model = xgbFit.LGOCV$finalModel) %>%
    xgb.ggplot.importance()

densityplot(xgbFit.LGOCV,pch='|')

predict(xgbFit.LGOCV,type = 'prob') -> train.Probs
histogram(~Survived+Dead,train.Probs)

Extreme Gradient Boosting (xgboost) - SMOTE Sampling

ctrl <- trainControl(method = "repeatedcv",
                     repeats = 5,
                     verboseIter = T,
                     classProbs = TRUE,
                     summaryFunction = twoClassSummary,
                     sampling = 'smote'
                     )
xgbGrid <- expand.grid(
    nrounds=c(2,3,4,5,6,7),
    max_depth=c(2,3,4,5,6,7),
    eta=c(0.3,0.5),
    gamma=1,
    colsample_bytree=1,
    min_child_weight=1,
    subsample=1
)
dumV <- dummyVars(formula = Survived~.,data = train.imp)
Dtrain <- predict(dumV,train.imp)
variable 'Survived' is not a factor
set.seed(1)
xgbsmoteFit <- train(
    x=Dtrain,
    y=train.imp$Survived,
    method = 'xgbTree',
    trControl = ctrl,
    # metric = "Kappa",
    tuneGrid = xgbGrid,
    verbose = TRUE
)
The metric "Accuracy" was not in the result set. ROC will be used instead.
+ Fold01.Rep1: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 

Attaching package: ‘DMwR’

The following object is masked from ‘package:plyr’:

    join
- Fold01.Rep1: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep1: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep1: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep1: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep1: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep1: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep1: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep1: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep1: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep1: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep1: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep1: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep1: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep1: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep1: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep1: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep1: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep1: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep1: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep1: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep1: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep1: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep1: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep1: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep1: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep1: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep1: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep1: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep1: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep1: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep1: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep1: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep1: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep1: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep1: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep1: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep1: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep1: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep1: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep1: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep1: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep1: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep1: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep1: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep1: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep1: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep1: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep1: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep1: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep1: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep1: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep1: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep1: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep1: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep1: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep1: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep1: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep1: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep1: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep1: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep1: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep1: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep1: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep1: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep1: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep1: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep1: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep1: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep1: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep1: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep1: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep1: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep1: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep1: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep1: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep1: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep1: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep1: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep1: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep1: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep1: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep1: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep1: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep1: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep1: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep1: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep1: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep1: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep1: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep1: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep1: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep1: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep1: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep1: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep1: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep1: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep1: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep1: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep1: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep1: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep1: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep1: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep1: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep1: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep1: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep1: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep1: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep1: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep1: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep1: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep1: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep1: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep1: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep1: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep1: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep1: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep1: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep1: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep1: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep1: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep1: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep1: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep1: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep1: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep1: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep1: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep1: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep1: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep1: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep1: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep1: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep1: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep1: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep1: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep1: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep1: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep1: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep1: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep1: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep1: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep1: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep1: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep1: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep1: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep1: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep1: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep1: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep1: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep1: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep1: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep1: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep1: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep1: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep1: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep1: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep1: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep1: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep1: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep1: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep1: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep1: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep1: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep1: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep1: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep1: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep1: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep1: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep1: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep1: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep1: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep1: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep1: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep1: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep1: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep1: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep1: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep1: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep1: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep1: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep1: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep1: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep1: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep1: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep1: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep1: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep1: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep1: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep1: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep1: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep1: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep1: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep1: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep1: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep1: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep1: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep1: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep1: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep1: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep1: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep1: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep1: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep1: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep1: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep1: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep1: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep1: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep1: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep1: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep1: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep1: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep1: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep1: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep1: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep1: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep1: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep1: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep1: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep1: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep1: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep1: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep1: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep1: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep1: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep1: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep1: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep1: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep1: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep1: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep1: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep1: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep1: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep1: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep1: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep1: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep1: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep1: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep1: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep1: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep1: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep2: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep2: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep2: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep2: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep2: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep2: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep2: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep2: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep2: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep2: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep2: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep2: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep2: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep2: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep2: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep2: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep2: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep2: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep2: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep2: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep2: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep2: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep2: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep2: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep2: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep2: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep2: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep2: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep2: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep2: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep2: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep2: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep2: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep2: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep2: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep2: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep2: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep2: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep2: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep2: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep2: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep2: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep2: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep2: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep2: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep2: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep2: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep2: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep2: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep2: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep2: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep2: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep2: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep2: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep2: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep2: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep2: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep2: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep2: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep2: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep2: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep2: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep2: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep2: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep2: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep2: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep2: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep2: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep2: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep2: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep2: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep2: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep2: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep2: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep2: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep2: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep2: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep2: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep2: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep2: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep2: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep2: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep2: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep2: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep2: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep2: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep2: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep2: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep2: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep2: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep2: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep2: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep2: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep2: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep2: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep2: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep2: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep2: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep2: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep2: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep2: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep2: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep2: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep2: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep2: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep2: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep2: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep2: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep2: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep2: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep2: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep2: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep2: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep2: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep2: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep2: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep2: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep2: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep2: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep2: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep2: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep2: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep2: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep2: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep2: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep2: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep2: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep2: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep2: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep2: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep2: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep2: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep2: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep2: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep2: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep2: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep2: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep2: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep2: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep2: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep2: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep2: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep2: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep2: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep2: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep2: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep2: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep2: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep2: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep2: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep2: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep2: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep2: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep2: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep2: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep2: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep2: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep2: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep2: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep2: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep2: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep2: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep2: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep2: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep2: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep2: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep2: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep2: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep2: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep2: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep2: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep2: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep2: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep2: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep2: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep2: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep2: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep2: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep2: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep2: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep2: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep2: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep2: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep2: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep2: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep2: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep2: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep2: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep2: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep2: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep2: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep2: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep2: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep2: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep2: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep2: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep2: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep2: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep2: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep2: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep2: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep2: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep2: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep2: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep2: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep2: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep2: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep2: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep2: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep2: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep2: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep2: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep2: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep2: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep2: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep2: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep2: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep2: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep2: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep2: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep2: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep2: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep2: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep2: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep2: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep2: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep2: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep2: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep2: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep2: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep2: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep2: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep2: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep2: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep2: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep2: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep2: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep2: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep2: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep2: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep3: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep3: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep3: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep3: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep3: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep3: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep3: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep3: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep3: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep3: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep3: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep3: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep3: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep3: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep3: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep3: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep3: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep3: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep3: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep3: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep3: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep3: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep3: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep3: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep3: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep3: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep3: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep3: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep3: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep3: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep3: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep3: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep3: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep3: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep3: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep3: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep3: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep3: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep3: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep3: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep3: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep3: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep3: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep3: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep3: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep3: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep3: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep3: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep3: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep3: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep3: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep3: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep3: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep3: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep3: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep3: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep3: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep3: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep3: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep3: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep3: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep3: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep3: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep3: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep3: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep3: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep3: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep3: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep3: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep3: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep3: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep3: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep3: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep3: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep3: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep3: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep3: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep3: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep3: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep3: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep3: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep3: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep3: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep3: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep3: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep3: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep3: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep3: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep3: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep3: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep3: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep3: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep3: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep3: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep3: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep3: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep3: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep3: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep3: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep3: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep3: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep3: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep3: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep3: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep3: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep3: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep3: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep3: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep3: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep3: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep3: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep3: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep3: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep3: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep3: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep3: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep3: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep3: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep3: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep3: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep3: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep3: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep3: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep3: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep3: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep3: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep3: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep3: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep3: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep3: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep3: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep3: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep3: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep3: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep3: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep3: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep3: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep3: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep3: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep3: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep3: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep3: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep3: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep3: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep3: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep3: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep3: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep3: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep3: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep3: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep3: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep3: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep3: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep3: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep3: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep3: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep3: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep3: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep3: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep3: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep3: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep3: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep3: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep3: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep3: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep3: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep3: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep3: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep3: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep3: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep3: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep3: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep3: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep3: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep3: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep3: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep3: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep3: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep3: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep3: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep3: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep3: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep3: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep3: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep3: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep3: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep3: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep3: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep3: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep3: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep3: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep3: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep3: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep3: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep3: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep3: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep3: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep3: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep3: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep3: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep3: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep3: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep3: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep3: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep3: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep3: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep3: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep3: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep3: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep3: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep3: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep3: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep3: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep3: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep3: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep3: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep3: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep3: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep3: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep3: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep3: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep3: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep3: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep3: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep3: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep3: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep3: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep3: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep3: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep3: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep3: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep3: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep3: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep3: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep3: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep3: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep3: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep3: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep3: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep3: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep4: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep4: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep4: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep4: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep4: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep4: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep4: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep4: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep4: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep4: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep4: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep4: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep4: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep4: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep4: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep4: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep4: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep4: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep4: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep4: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep4: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep4: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep4: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep4: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep4: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep4: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep4: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep4: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep4: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep4: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep4: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep4: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep4: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep4: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep4: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep4: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep4: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep4: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep4: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep4: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep4: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep4: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep4: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep4: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep4: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep4: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep4: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep4: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep4: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep4: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep4: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep4: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep4: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep4: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep4: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep4: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep4: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep4: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep4: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep4: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep4: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep4: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep4: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep4: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep4: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep4: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep4: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep4: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep4: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep4: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep4: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep4: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep4: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep4: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep4: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep4: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep4: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep4: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep4: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep4: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep4: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep4: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep4: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep4: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep4: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep4: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep4: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep4: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep4: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep4: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep4: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep4: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep4: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep4: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep4: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep4: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep4: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep4: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep4: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep4: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep4: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep4: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep4: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep4: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep4: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep4: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep4: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep4: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep4: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep4: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep4: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep4: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep4: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep4: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep4: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep4: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep4: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep4: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep4: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep4: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep4: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep4: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep4: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep4: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep4: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep4: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep4: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep4: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep4: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep4: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep4: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep4: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep4: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep4: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep4: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep4: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep4: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep4: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep4: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep4: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep4: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep4: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep4: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep4: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep4: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep4: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep4: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep4: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep4: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep4: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep4: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep4: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep4: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep4: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep4: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep4: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep4: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep4: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep4: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep4: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep4: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep4: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep4: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep4: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep4: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep4: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep4: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep4: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep4: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep4: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep4: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep4: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep4: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep4: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep4: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep4: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep4: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep4: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep4: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep4: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep4: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep4: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep4: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep4: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep4: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep4: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep4: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep4: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep4: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep4: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep4: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep4: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep4: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep4: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep4: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep4: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep4: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep4: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep4: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep4: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep4: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep4: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep4: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep4: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep4: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep4: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep4: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep4: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep4: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep4: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep4: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep4: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep4: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep4: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep4: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep4: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep4: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep4: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep4: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep4: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep4: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep4: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep4: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep4: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep4: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep4: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep4: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep4: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep4: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep4: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep4: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep4: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep4: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep4: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep4: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep4: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep4: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep4: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep4: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep4: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep5: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep5: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep5: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep5: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep5: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep5: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep5: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep5: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep5: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep5: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep5: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep5: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep5: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep5: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep5: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep5: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep5: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep5: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep5: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep5: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep5: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep5: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep5: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep5: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep5: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep5: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep5: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep5: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep5: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep5: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep5: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep5: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep5: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep5: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep5: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep5: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep5: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep5: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep5: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep5: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep5: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep5: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep5: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep5: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep5: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep5: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep5: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep5: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep5: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep5: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep5: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep5: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep5: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep5: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep5: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep5: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep5: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep5: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep5: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep5: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep5: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep5: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep5: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep5: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep5: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep5: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep5: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep5: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep5: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep5: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep5: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep5: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep5: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep5: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep5: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep5: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep5: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep5: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep5: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep5: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep5: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep5: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep5: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep5: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep5: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep5: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep5: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep5: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep5: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep5: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep5: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep5: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep5: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep5: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep5: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep5: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep5: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep5: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep5: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep5: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep5: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep5: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep5: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep5: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep5: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep5: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep5: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep5: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep5: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep5: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep5: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep5: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep5: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep5: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep5: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep5: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep5: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep5: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep5: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep5: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep5: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep5: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep5: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep5: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep5: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep5: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep5: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep5: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep5: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep5: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep5: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep5: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep5: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep5: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep5: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep5: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep5: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep5: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep5: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep5: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep5: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep5: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep5: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep5: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep5: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep5: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep5: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep5: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep5: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep5: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep5: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep5: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep5: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep5: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep5: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep5: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep5: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep5: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep5: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep5: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep5: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep5: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep5: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep5: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep5: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep5: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep5: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep5: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep5: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep5: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep5: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep5: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep5: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep5: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep5: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep5: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep5: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep5: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep5: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep5: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep5: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep5: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep5: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep5: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep5: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep5: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep5: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep5: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep5: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep5: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep5: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep5: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep5: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep5: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep5: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep5: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep5: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep5: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep5: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep5: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep5: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep5: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep5: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep5: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep5: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep5: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep5: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep5: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep5: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep5: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep5: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep5: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep5: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep5: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep5: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep5: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep5: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep5: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep5: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep5: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep5: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep5: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep5: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep5: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep5: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep5: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep5: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep5: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep5: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep5: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep5: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep5: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep5: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep5: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep5: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep5: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep5: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep5: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep5: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep5: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
Aggregating results
Selecting tuning parameters
Fitting nrounds = 7, max_depth = 6, eta = 0.5, gamma = 1, colsample_bytree = 1, min_child_weight = 1, subsample = 1 on full training set
xgbsmoteFit
eXtreme Gradient Boosting 

891 samples
 53 predictor
  2 classes: 'Survived', 'Dead' 

No pre-processing
Resampling: Cross-Validated (10 fold, repeated 5 times) 
Summary of sample sizes: 803, 802, 802, 802, 802, 802, ... 
Addtional sampling using SMOTE

Resampling results across tuning parameters:

  eta  max_depth  nrounds  ROC        Sens       Spec     
  0.3  2          2        0.8421146  0.5939328  0.9082559
  0.3  2          3        0.8483595  0.6400000  0.9024242
  0.3  2          4        0.8551781  0.6580000  0.9017037
  0.3  2          5        0.8609146  0.6563697  0.9038519
  0.3  2          6        0.8649248  0.6597983  0.9046061
  0.3  2          7        0.8670126  0.6550756  0.9093670
  0.3  3          2        0.8613064  0.6313109  0.9162694
  0.3  3          3        0.8639470  0.6114118  0.9224579
  0.3  3          4        0.8653315  0.6101513  0.9257374
  0.3  3          5        0.8665421  0.6055630  0.9260943
  0.3  3          6        0.8696859  0.6037983  0.9271785
  0.3  3          7        0.8716434  0.6007563  0.9322761
  0.3  4          2        0.8609969  0.6036471  0.9311919
  0.3  4          3        0.8652289  0.6163866  0.9301347
  0.3  4          4        0.8688009  0.6158655  0.9366801
  0.3  4          5        0.8726035  0.6210924  0.9388485
  0.3  4          6        0.8751455  0.6099328  0.9414007
  0.3  4          7        0.8749105  0.6128908  0.9395758
  0.3  5          2        0.8601735  0.6023193  0.9333603
  0.3  5          3        0.8610160  0.5988908  0.9344444
  0.3  5          4        0.8667343  0.6082017  0.9362896
  0.3  5          5        0.8706154  0.6145546  0.9311785
  0.3  5          6        0.8722259  0.6197815  0.9308215
  0.3  5          7        0.8737761  0.6244538  0.9322828
  0.3  6          2        0.8580192  0.6235462  0.9227946
  0.3  6          3        0.8583093  0.6247059  0.9216902
  0.3  6          4        0.8626271  0.6206387  0.9253333
  0.3  6          5        0.8661660  0.6339832  0.9268013
  0.3  6          6        0.8690932  0.6369412  0.9264242
  0.3  6          7        0.8716388  0.6515966  0.9213199
  0.3  7          2        0.8611640  0.6346723  0.9169630
  0.3  7          3        0.8647727  0.6340000  0.9187811
  0.3  7          4        0.8666008  0.6405210  0.9213401
  0.3  7          5        0.8698512  0.6487059  0.9184242
  0.3  7          6        0.8701002  0.6504202  0.9165993
  0.3  7          7        0.8739733  0.6621008  0.9133199
  0.5  2          2        0.8488864  0.6380840  0.9082492
  0.5  2          3        0.8575909  0.6740336  0.8965791
  0.5  2          4        0.8642655  0.6347731  0.9137306
  0.5  2          5        0.8645471  0.6294286  0.9187946
  0.5  2          6        0.8705065  0.6159664  0.9221145
  0.5  2          7        0.8705196  0.6112605  0.9257172
  0.5  3          2        0.8628080  0.6190588  0.9224242
  0.5  3          3        0.8668252  0.6037311  0.9264444
  0.5  3          4        0.8698613  0.5954454  0.9293333
  0.5  3          5        0.8718494  0.6077311  0.9304310
  0.5  3          6        0.8749923  0.6100672  0.9344310
  0.5  3          7        0.8756202  0.6142521  0.9406195
  0.5  4          2        0.8621987  0.5960504  0.9432189
  0.5  4          3        0.8711300  0.6007395  0.9373872
  0.5  4          4        0.8760000  0.6077815  0.9399192
  0.5  4          5        0.8751627  0.6269916  0.9344781
  0.5  4          6        0.8740639  0.6181345  0.9359192
  0.5  4          7        0.8735838  0.6247059  0.9341077
  0.5  5          2        0.8603518  0.6018319  0.9333872
  0.5  5          3        0.8689792  0.6158992  0.9308013
  0.5  5          4        0.8712972  0.6246218  0.9289832
  0.5  5          5        0.8732240  0.6350924  0.9249764
  0.5  5          6        0.8706622  0.6474118  0.9231515
  0.5  5          7        0.8716543  0.6520504  0.9220808
  0.5  6          2        0.8629268  0.6323025  0.9202357
  0.5  6          3        0.8680653  0.6421008  0.9213131
  0.5  6          4        0.8719936  0.6385882  0.9187811
  0.5  6          5        0.8722299  0.6532605  0.9158586
  0.5  6          6        0.8754213  0.6708235  0.9129293
  0.5  6          7        0.8787050  0.6673445  0.9129293
  0.5  7          2        0.8653486  0.6469580  0.9278788
  0.5  7          3        0.8679310  0.6545546  0.9195152
  0.5  7          4        0.8700789  0.6597479  0.9187879
  0.5  7          5        0.8746540  0.6708739  0.9202424
  0.5  7          6        0.8743795  0.6773613  0.9166061
  0.5  7          7        0.8771199  0.6796807  0.9165926

Tuning parameter 'gamma' was held constant at a value of 1
Tuning parameter
 'colsample_bytree' was held constant at a value of 1
Tuning parameter 'min_child_weight'
 was held constant at a value of 1
Tuning parameter 'subsample' was held constant at a value of 1
ROC was used to select the optimal model using  the largest value.
The final values used for the model were nrounds = 7, max_depth = 6, eta = 0.5, gamma =
 1, colsample_bytree = 1, min_child_weight = 1 and subsample = 1.
plot(xgbsmoteFit)

xgb.importance(feature_names = colnames(Dtrain),model = xgbsmoteFit$finalModel)
xgb.importance(feature_names = colnames(Dtrain),model = xgbsmoteFit$finalModel) %>%
xgb.ggplot.importance()

densityplot(xgbsmoteFit,pch='|')

predict(xgbsmoteFit,type = 'raw') -> train.Class
predict(xgbsmoteFit,type = 'prob') -> train.Probs
histogram(~Survived+Dead,train.Probs)

Extreme Gradient Boosting (xgboost) - down Sampling

ctrl <- trainControl(method = "repeatedcv",
                     repeats = 5,
                     verboseIter = T,
                     classProbs = TRUE,
                     summaryFunction = twoClassSummary,
                     sampling = 'down'
                     )
xgbGrid <- expand.grid(
    nrounds=c(2,3,4,5,6,7),
    max_depth=c(2,3,4,5,6,7),
    eta=c(0.3,0.5),
    gamma=1,
    colsample_bytree=1,
    min_child_weight=1,
    subsample=1
)
dumV <- dummyVars(formula = Survived~.,data = train.imp)
Dtrain <- predict(dumV,train.imp)
variable 'Survived' is not a factor
set.seed(1)
xgbdownFit <- train(
    x=Dtrain,
    y=train.imp$Survived,
    method = 'xgbTree',
    trControl = ctrl,
    # metric = "Kappa",
    tuneGrid = xgbGrid,
    verbose = TRUE
)
The metric "Accuracy" was not in the result set. ROC will be used instead.
+ Fold01.Rep1: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep1: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep1: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep1: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep1: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep1: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep1: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep1: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep1: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep1: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep1: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep1: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep1: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep1: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep1: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep1: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep1: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep1: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep1: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep1: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep1: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep1: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep1: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep1: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep1: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep1: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep1: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep1: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep1: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep1: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep1: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep1: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep1: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep1: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep1: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep1: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep1: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep1: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep1: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep1: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep1: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep1: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep1: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep1: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep1: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep1: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep1: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep1: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep1: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep1: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep1: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep1: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep1: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep1: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep1: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep1: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep1: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep1: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep1: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep1: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep1: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep1: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep1: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep1: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep1: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep1: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep1: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep1: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep1: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep1: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep1: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep1: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep1: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep1: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep1: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep1: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep1: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep1: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep1: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep1: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep1: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep1: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep1: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep1: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep1: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep1: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep1: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep1: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep1: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep1: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep1: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep1: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep1: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep1: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep1: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep1: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep1: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep1: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep1: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep1: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep1: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep1: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep1: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep1: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep1: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep1: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep1: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep1: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep1: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep1: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep1: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep1: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep1: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep1: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep1: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep1: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep1: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep1: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep1: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep1: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep1: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep1: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep1: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep1: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep1: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep1: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep1: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep1: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep1: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep1: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep1: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep1: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep1: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep1: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep1: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep1: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep1: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep1: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep1: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep1: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep1: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep1: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep1: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep1: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep1: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep1: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep1: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep1: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep1: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep1: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep1: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep1: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep1: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep1: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep1: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep1: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep1: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep1: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep1: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep1: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep1: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep1: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep1: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep1: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep1: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep1: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep1: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep1: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep1: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep1: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep1: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep1: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep1: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep1: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep1: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep1: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep1: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep1: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep1: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep1: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep1: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep1: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep1: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep1: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep1: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep1: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep1: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep1: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep1: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep1: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep1: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep1: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep1: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep1: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep1: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep1: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep1: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep1: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep1: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep1: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep1: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep1: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep1: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep1: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep1: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep1: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep1: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep1: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep1: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep1: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep1: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep1: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep1: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep1: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep1: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep1: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep1: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep1: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep1: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep1: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep1: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep1: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep1: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep1: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep1: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep1: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep1: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep1: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep1: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep1: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep1: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep1: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep1: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep1: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep1: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep1: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep1: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep1: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep1: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep1: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep2: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep2: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep2: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep2: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep2: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep2: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep2: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep2: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep2: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep2: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep2: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep2: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep2: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep2: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep2: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep2: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep2: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep2: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep2: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep2: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep2: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep2: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep2: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep2: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep2: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep2: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep2: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep2: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep2: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep2: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep2: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep2: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep2: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep2: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep2: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep2: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep2: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep2: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep2: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep2: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep2: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep2: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep2: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep2: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep2: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep2: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep2: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep2: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep2: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep2: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep2: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep2: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep2: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep2: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep2: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep2: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep2: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep2: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep2: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep2: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep2: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep2: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep2: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep2: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep2: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep2: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep2: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep2: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep2: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep2: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep2: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep2: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep2: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep2: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep2: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep2: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep2: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep2: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep2: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep2: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep2: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep2: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep2: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep2: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep2: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep2: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep2: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep2: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep2: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep2: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep2: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep2: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep2: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep2: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep2: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep2: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep2: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep2: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep2: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep2: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep2: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep2: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep2: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep2: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep2: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep2: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep2: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep2: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep2: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep2: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep2: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep2: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep2: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep2: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep2: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep2: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep2: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep2: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep2: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep2: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep2: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep2: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep2: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep2: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep2: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep2: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep2: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep2: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep2: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep2: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep2: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep2: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep2: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep2: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep2: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep2: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep2: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep2: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep2: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep2: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep2: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep2: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep2: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep2: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep2: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep2: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep2: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep2: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep2: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep2: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep2: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep2: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep2: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep2: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep2: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep2: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep2: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep2: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep2: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep2: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep2: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep2: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep2: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep2: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep2: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep2: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep2: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep2: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep2: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep2: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep2: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep2: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep2: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep2: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep2: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep2: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep2: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep2: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep2: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep2: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep2: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep2: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep2: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep2: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep2: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep2: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep2: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep2: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep2: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep2: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep2: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep2: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep2: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep2: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep2: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep2: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep2: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep2: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep2: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep2: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep2: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep2: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep2: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep2: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep2: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep2: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep2: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep2: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep2: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep2: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep2: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep2: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep2: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep2: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep2: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep2: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep2: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep2: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep2: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep2: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep2: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep2: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep2: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep2: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep2: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep2: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep2: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep2: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep2: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep2: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep2: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep2: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep2: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep2: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep2: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep2: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep2: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep2: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep2: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep2: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep3: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep3: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep3: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep3: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep3: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep3: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep3: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep3: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep3: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep3: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep3: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep3: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep3: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep3: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep3: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep3: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep3: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep3: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep3: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep3: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep3: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep3: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep3: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep3: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep3: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep3: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep3: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep3: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep3: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep3: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep3: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep3: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep3: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep3: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep3: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep3: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep3: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep3: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep3: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep3: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep3: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep3: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep3: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep3: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep3: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep3: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep3: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep3: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep3: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep3: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep3: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep3: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep3: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep3: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep3: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep3: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep3: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep3: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep3: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep3: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep3: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep3: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep3: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep3: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep3: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep3: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep3: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep3: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep3: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep3: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep3: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep3: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep3: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep3: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep3: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep3: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep3: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep3: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep3: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep3: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep3: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep3: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep3: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep3: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep3: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep3: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep3: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep3: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep3: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep3: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep3: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep3: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep3: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep3: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep3: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep3: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep3: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep3: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep3: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep3: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep3: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep3: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep3: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep3: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep3: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep3: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep3: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep3: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep3: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep3: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep3: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep3: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep3: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep3: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep3: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep3: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep3: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep3: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep3: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep3: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep3: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep3: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep3: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep3: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep3: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep3: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep3: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep3: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep3: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep3: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep3: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep3: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep3: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep3: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep3: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep3: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep3: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep3: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep3: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep3: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep3: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep3: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep3: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep3: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep3: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep3: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep3: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep3: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep3: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep3: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep3: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep3: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep3: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep3: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep3: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep3: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep3: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep3: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep3: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep3: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep3: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep3: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep3: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep3: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep3: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep3: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep3: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep3: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep3: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep3: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep3: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep3: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep3: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep3: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep3: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep3: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep3: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep3: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep3: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep3: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep3: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep3: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep3: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep3: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep3: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep3: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep3: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep3: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep3: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep3: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep3: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep3: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep3: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep3: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep3: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep3: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep3: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep3: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep3: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep3: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep3: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep3: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep3: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep3: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep3: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep3: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep3: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep3: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep3: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep3: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep3: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep3: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep3: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep3: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep3: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep3: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep3: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep3: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep3: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep3: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep3: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep3: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep3: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep3: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep3: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep3: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep3: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep3: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep3: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep3: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep3: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep3: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep3: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep3: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep3: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep3: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep3: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep3: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep3: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep3: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep4: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep4: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep4: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep4: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep4: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep4: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep4: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep4: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep4: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep4: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep4: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep4: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep4: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep4: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep4: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep4: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep4: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep4: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep4: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep4: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep4: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep4: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep4: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep4: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep4: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep4: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep4: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep4: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep4: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep4: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep4: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep4: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep4: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep4: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep4: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep4: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep4: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep4: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep4: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep4: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep4: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep4: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep4: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep4: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep4: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep4: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep4: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep4: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep4: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep4: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep4: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep4: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep4: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep4: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep4: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep4: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep4: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep4: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep4: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep4: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep4: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep4: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep4: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep4: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep4: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep4: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep4: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep4: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep4: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep4: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep4: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep4: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep4: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep4: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep4: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep4: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep4: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep4: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep4: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep4: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep4: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep4: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep4: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep4: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep4: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep4: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep4: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep4: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep4: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep4: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep4: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep4: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep4: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep4: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep4: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep4: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep4: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep4: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep4: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep4: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep4: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep4: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep4: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep4: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep4: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep4: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep4: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep4: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep4: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep4: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep4: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep4: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep4: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep4: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep4: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep4: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep4: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep4: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep4: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep4: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep4: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep4: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep4: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep4: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep4: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep4: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep4: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep4: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep4: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep4: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep4: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep4: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep4: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep4: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep4: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep4: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep4: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep4: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep4: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep4: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep4: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep4: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep4: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep4: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep4: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep4: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep4: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep4: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep4: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep4: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep4: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep4: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep4: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep4: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep4: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep4: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep4: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep4: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep4: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep4: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep4: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep4: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep4: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep4: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep4: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep4: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep4: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep4: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep4: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep4: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep4: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep4: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep4: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep4: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep4: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep4: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep4: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep4: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep4: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep4: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep4: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep4: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep4: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep4: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep4: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep4: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep4: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep4: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep4: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep4: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep4: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep4: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep4: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep4: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep4: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep4: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep4: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep4: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep4: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep4: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep4: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep4: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep4: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep4: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep4: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep4: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep4: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep4: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep4: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep4: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep4: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep4: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep4: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep4: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep4: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep4: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep4: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep4: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep4: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep4: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep4: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep4: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep4: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep4: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep4: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep4: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep4: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep4: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep4: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep4: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep4: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep4: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep4: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep4: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep4: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep4: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep4: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep4: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep4: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep4: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep5: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep5: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep5: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep5: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep5: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep5: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep5: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep5: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep5: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep5: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep5: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep5: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep5: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep5: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep5: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep5: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep5: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep5: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep5: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep5: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep5: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep5: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold01.Rep5: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold01.Rep5: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep5: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep5: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep5: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep5: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep5: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep5: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep5: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep5: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep5: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep5: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep5: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep5: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep5: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep5: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep5: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep5: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep5: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep5: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep5: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep5: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep5: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep5: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold02.Rep5: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold02.Rep5: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep5: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep5: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep5: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep5: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep5: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep5: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep5: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep5: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep5: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep5: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep5: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep5: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep5: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep5: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep5: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep5: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep5: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep5: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep5: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep5: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep5: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep5: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold03.Rep5: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold03.Rep5: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep5: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep5: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep5: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep5: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep5: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep5: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep5: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep5: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep5: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep5: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep5: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep5: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep5: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep5: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep5: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep5: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep5: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep5: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep5: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep5: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep5: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep5: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold04.Rep5: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold04.Rep5: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep5: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep5: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep5: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep5: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep5: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep5: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep5: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep5: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep5: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep5: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep5: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep5: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep5: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep5: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep5: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep5: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep5: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep5: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep5: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep5: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep5: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep5: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold05.Rep5: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold05.Rep5: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep5: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep5: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep5: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep5: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep5: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep5: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep5: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep5: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep5: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep5: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep5: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep5: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep5: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep5: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep5: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep5: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep5: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep5: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep5: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep5: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep5: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep5: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold06.Rep5: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold06.Rep5: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep5: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep5: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep5: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep5: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep5: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep5: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep5: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep5: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep5: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep5: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep5: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep5: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep5: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep5: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep5: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep5: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep5: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep5: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep5: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep5: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep5: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep5: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold07.Rep5: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold07.Rep5: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep5: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep5: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep5: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep5: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep5: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep5: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep5: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep5: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep5: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep5: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep5: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep5: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep5: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep5: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep5: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep5: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep5: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep5: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep5: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep5: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep5: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep5: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold08.Rep5: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold08.Rep5: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep5: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep5: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep5: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep5: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep5: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep5: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep5: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep5: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep5: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep5: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep5: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep5: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep5: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep5: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep5: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep5: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep5: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep5: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep5: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep5: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep5: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep5: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold09.Rep5: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold09.Rep5: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep5: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep5: eta=0.3, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep5: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep5: eta=0.3, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep5: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep5: eta=0.3, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep5: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep5: eta=0.3, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep5: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep5: eta=0.3, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep5: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep5: eta=0.3, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep5: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep5: eta=0.5, max_depth=2, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep5: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep5: eta=0.5, max_depth=3, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep5: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep5: eta=0.5, max_depth=4, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep5: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep5: eta=0.5, max_depth=5, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep5: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep5: eta=0.5, max_depth=6, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
+ Fold10.Rep5: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
- Fold10.Rep5: eta=0.5, max_depth=7, gamma=1, colsample_bytree=1, min_child_weight=1, subsample=1, nrounds=7 
Aggregating results
Selecting tuning parameters
Fitting nrounds = 7, max_depth = 6, eta = 0.3, gamma = 1, colsample_bytree = 1, min_child_weight = 1, subsample = 1 on full training set
xgbdownFit
eXtreme Gradient Boosting 

891 samples
 53 predictor
  2 classes: 'Survived', 'Dead' 

No pre-processing
Resampling: Cross-Validated (10 fold, repeated 5 times) 
Summary of sample sizes: 803, 802, 802, 802, 802, 802, ... 
Addtional sampling using down-sampling

Resampling results across tuning parameters:

  eta  max_depth  nrounds  ROC        Sens       Spec     
  0.3  2          2        0.8569065  0.7830756  0.8181953
  0.3  2          3        0.8644267  0.7929580  0.8189158
  0.3  2          4        0.8656720  0.7777311  0.8298855
  0.3  2          5        0.8675445  0.7737479  0.8342626
  0.3  2          6        0.8683614  0.7737143  0.8367811
  0.3  2          7        0.8696930  0.7860672  0.8269495
  0.3  3          2        0.8666484  0.7976303  0.8091582
  0.3  3          3        0.8731929  0.7964874  0.8240606
  0.3  3          4        0.8750420  0.7970756  0.8328418
  0.3  3          5        0.8754808  0.7982521  0.8339057
  0.3  3          6        0.8764200  0.7982353  0.8371717
  0.3  3          7        0.8748266  0.7988235  0.8368081
  0.3  4          2        0.8678127  0.8052605  0.8087071
  0.3  4          3        0.8752221  0.7981849  0.8236700
  0.3  4          4        0.8752527  0.8011261  0.8323973
  0.3  4          5        0.8761151  0.7976303  0.8309428
  0.3  4          6        0.8763856  0.8034958  0.8375017
  0.3  4          7        0.8763981  0.8028403  0.8415219
  0.3  5          2        0.8710305  0.8146555  0.8079865
  0.3  5          3        0.8742439  0.8059160  0.8170774
  0.3  5          4        0.8737292  0.8040504  0.8232727
  0.3  5          5        0.8756644  0.7993950  0.8294478
  0.3  5          6        0.8775969  0.7947227  0.8331178
  0.3  5          7        0.8784699  0.7930420  0.8353266
  0.3  6          2        0.8665360  0.7982521  0.8043502
  0.3  6          3        0.8726915  0.7913277  0.8171178
  0.3  6          4        0.8746105  0.7976639  0.8214949
  0.3  6          5        0.8771985  0.7930252  0.8320471
  0.3  6          6        0.8783720  0.7877311  0.8360539
  0.3  6          7        0.8799762  0.7895462  0.8324444
  0.3  7          2        0.8673833  0.7935798  0.8087205
  0.3  7          3        0.8695888  0.7942017  0.8119798
  0.3  7          4        0.8737363  0.7901008  0.8188956
  0.3  7          5        0.8750842  0.7953109  0.8269562
  0.3  7          6        0.8754110  0.7923866  0.8313131
  0.3  7          7        0.8763099  0.7930084  0.8338653
  0.5  2          2        0.8614709  0.7971092  0.8069428
  0.5  2          3        0.8649317  0.7908235  0.8171178
  0.5  2          4        0.8668110  0.7889244  0.8200673
  0.5  2          5        0.8661688  0.7901681  0.8197037
  0.5  2          6        0.8690462  0.8011597  0.8160606
  0.5  2          7        0.8721577  0.8057983  0.8182626
  0.5  3          2        0.8715849  0.7843529  0.8277239
  0.5  3          3        0.8746048  0.7895462  0.8280741
  0.5  3          4        0.8733359  0.7872269  0.8353670
  0.5  3          5        0.8725359  0.7948403  0.8302492
  0.5  3          6        0.8730766  0.7994958  0.8287879
  0.5  3          7        0.8733655  0.8047563  0.8251582
  0.5  4          2        0.8725090  0.7937311  0.8269764
  0.5  4          3        0.8752285  0.7929916  0.8288215
  0.5  4          4        0.8716937  0.7913109  0.8368013
  0.5  4          5        0.8714207  0.7825210  0.8382896
  0.5  4          6        0.8727354  0.7848739  0.8390303
  0.5  4          7        0.8722140  0.7843025  0.8364646
  0.5  5          2        0.8732848  0.8036134  0.8219192
  0.5  5          3        0.8758392  0.7924202  0.8222088
  0.5  5          4        0.8750053  0.7947395  0.8313535
  0.5  5          5        0.8734751  0.7942521  0.8335623
  0.5  5          6        0.8750399  0.7930252  0.8375556
  0.5  5          7        0.8742379  0.7913109  0.8375623
  0.5  6          2        0.8702289  0.7947563  0.8204108
  0.5  6          3        0.8712628  0.7907059  0.8317239
  0.5  6          4        0.8751280  0.7895798  0.8393603
  0.5  6          5        0.8743984  0.7901345  0.8371650
  0.5  6          6        0.8755410  0.7895630  0.8342694
  0.5  6          7        0.8771089  0.7912941  0.8357576
  0.5  7          2        0.8703945  0.8059832  0.8156970
  0.5  7          3        0.8707655  0.8035966  0.8240741
  0.5  7          4        0.8750083  0.8018319  0.8295286
  0.5  7          5        0.8769117  0.7988739  0.8364646
  0.5  7          6        0.8760763  0.8012773  0.8368350
  0.5  7          7        0.8761337  0.8006555  0.8331650

Tuning parameter 'gamma' was held constant at a value of 1
Tuning parameter
 'colsample_bytree' was held constant at a value of 1
Tuning parameter 'min_child_weight'
 was held constant at a value of 1
Tuning parameter 'subsample' was held constant at a value of 1
ROC was used to select the optimal model using  the largest value.
The final values used for the model were nrounds = 7, max_depth = 6, eta = 0.3, gamma =
 1, colsample_bytree = 1, min_child_weight = 1 and subsample = 1.
plot(xgbdownFit)

xgb.importance(feature_names = colnames(Dtrain),model = xgbdownFit$finalModel)
xgb.importance(feature_names = colnames(Dtrain),model = xgbdownFit$finalModel) %>%
xgb.ggplot.importance()

densityplot(xgbdownFit,pch='|')

predict(xgbdownFit,type = 'raw') -> train.Class
predict(xgbdownFit,type = 'prob') -> train.Probs
histogram(~Survived+Dead,train.Probs)

Gradient Boosting (gbm)

boostFit
Stochastic Gradient Boosting 

891 samples
 53 predictor
  2 classes: 'Survived', 'Dead' 

No pre-processing
Resampling: Cross-Validated (10 fold, repeated 5 times) 
Summary of sample sizes: 803, 802, 802, 802, 802, 802, ... 
Resampling results across tuning parameters:

  shrinkage  interaction.depth  n.trees  ROC        Sens       Spec     
  0.01       1                   500     0.8687740  0.7176975  0.8812727
  0.01       1                   700     0.8715465  0.7310756  0.8827340
  0.01       1                   900     0.8731344  0.7456975  0.8798182
  0.01       1                  1100     0.8737417  0.7614454  0.8790909
  0.01       2                   500     0.8768379  0.7410252  0.8819933
  0.01       2                   700     0.8781806  0.7549916  0.8808956
  0.01       2                   900     0.8791223  0.7614118  0.8801751
  0.01       2                  1100     0.8801043  0.7613950  0.8809024
  0.01       3                   500     0.8790775  0.7526218  0.8823636
  0.01       3                   700     0.8808075  0.7584874  0.8812727
  0.01       3                   900     0.8815746  0.7549748  0.8809091
  0.01       3                  1100     0.8817104  0.7532269  0.8849091
  0.10       1                   500     0.8699484  0.7480168  0.8721751
  0.10       1                   700     0.8708636  0.7485882  0.8736162
  0.10       1                   900     0.8686151  0.7422017  0.8743367
  0.10       1                  1100     0.8689881  0.7428067  0.8725051
  0.10       2                   500     0.8801393  0.7473950  0.8837845
  0.10       2                   700     0.8799571  0.7467563  0.8819798
  0.10       2                   900     0.8790711  0.7438992  0.8790370
  0.10       2                  1100     0.8773468  0.7474118  0.8757778
  0.10       3                   500     0.8803987  0.7450252  0.8790774
  0.10       3                   700     0.8805280  0.7438655  0.8746869
  0.10       3                   900     0.8793306  0.7438655  0.8692189
  0.10       3                  1100     0.8785908  0.7432773  0.8713872

Tuning parameter 'n.minobsinnode' was held constant at a value of 10
ROC was used to select the optimal model using  the largest value.
The final values used for the model were n.trees = 1100, interaction.depth = 3, shrinkage
 = 0.01 and n.minobsinnode = 10.
plot(boostFit)

xyplot(oobag.improve~1:1100,data=boostFit$finalModel,alpha=.5,xlab = 'n.trees')

plot(varImp(boostFit))

densityplot(boostFit,pch='|')

predict(boostFit,type = 'prob') -> train.Probs
histogram(~Survived+Dead,train.Probs)

Random Forest (custom rf)

customRF <-
    list(type = "Classification",
    library = "randomForest",
    loop = NULL)
customRF$parameters <- data.frame(
    parameter = c("mtry", "ntree", 'nodesize', 'replace'),
    class = c("numeric", 'numeric', 'numeric', 'logical'),
    label = c("mtry", "ntree", 'nodesize', 'replace')
    )
customRF$grid <- function(x, y, len = NULL, search = "grid") {}
customRF$fit <-
    function(x,
    y,
    wts,
    param,
    lev,
    last,
    weights,
    classProbs,
    ...) {
    randomForest(
    x,
    y,
    mtry = param$mtry,
    ntree = param$ntree,
    replace = param$replace,
    # classwt = param$classwt,
    nodesize = param$nodesize
    )
    }
customRF$predict <-
    function(modelFit,
    newdata,
    preProc = NULL,
    submodels = NULL)
    predict(modelFit, newdata)
customRF$prob <-
    function(modelFit,
    newdata,
    preProc = NULL,
    submodels = NULL)
        predict(modelFit, newdata, type = "prob")
customRF$sort <- function(x)
    x[order(x[, 1]), ]
customRF$levels <- function(x)
    x$classes
customRF
$type
[1] "Classification"

$library
[1] "randomForest"

$loop
NULL

$parameters

$grid
function (x, y, len = NULL, search = "grid") 
{
}

$fit
function (x, y, wts, param, lev, last, weights, classProbs, ...) 
{
    randomForest(x, y, mtry = param$mtry, ntree = param$ntree, 
        replace = param$replace, nodesize = param$nodesize)
}

$predict
function (modelFit, newdata, preProc = NULL, submodels = NULL) 
predict(modelFit, newdata)

$prob
function (modelFit, newdata, preProc = NULL, submodels = NULL) 
predict(modelFit, newdata, type = "prob")

$sort
function (x) 
x[order(x[, 1]), ]

$levels
function (x) 
x$classes
    
    
ctrl <- trainControl(
    method = "repeatedcv",
    repeats = 5,
    verboseIter = T,
    classProbs = TRUE,
    summaryFunction = twoClassSummary,
    # sampling = 'smote'
)
crfGrid <- expand.grid(
    mtry = c(10, 15, 20, 29),
    ntree = c(100, 300, 500),
    nodesize = c(1, 5, 10),
    replace = c(T, F)
    # classwt = c(0.6, 0.8)
)
set.seed(1)
crfFit <- train(
    form = Survived ~ .,
    data = train.imp,
    method = customRF,
    trControl = adapt_ctrl,
    # metric = "Kappa",
    tuneGrid = crfGrid,
    verbose = TRUE,
    classwt = c(0.38, 0.61)
)
Error in na.fail.default(list(Survived = c(2L, 1L, 1L, 1L, 2L, 2L, 2L,  : 
  missing values in object

Conditional Forest (ctree)

cforestFit
Conditional Inference Random Forest 

891 samples
 28 predictor
  2 classes: 'Survived', 'Dead' 

No pre-processing
Resampling: Cross-Validated (10 fold, repeated 5 times) 
Summary of sample sizes: 803, 802, 802, 802, 802, 802, ... 
Resampling results across tuning parameters:

  mtry  ROC        Sens       Spec     
  10    0.8735439  0.7025042  0.8969360
  20    0.8778289  0.7153109  0.9009293
  30    0.8803729  0.7082017  0.9009360
  40    0.8813999  0.7012269  0.8998249

ROC was used to select the optimal model using  the largest value.
The final value used for the model was mtry = 40.
plot(cforestFit)

densityplot(cforestFit,pch='|')

Random Forest (rf)

adapt_ctrl <- trainControl(method = "repeatedcv",
                     repeats = 5,
                     verboseIter = T,
                     classProbs = TRUE,
                     summaryFunction = twoClassSummary,
                     adaptive = list(min = 5, alpha = 0.05, 
                                             method = "gls", complete = TRUE),
                     search = 'random'
                     )

rfGrid <- expand.grid(mtry=c(5,10,15,20,25))
set.seed(1)
rfFit.y <- train(
    form = Survived~.,
    data = train.imp,
    method = 'rf',
    trControl = adapt_ctrl,
    tuneGrid = rfGrid,
    verbose = TRUE,
    ntree = 400
)
rfFit.y
plot(rfFit.y)
plot(rfFit.y$finalModel)
densityplot(rfFit.y,pch='|')
predict(rfFit.y,type = 'prob') -> train.rf.Probs
histogram(~Survived+Dead,train.rf.Probs)

Random Forest (rf) - SMOTE

rfsmoteFit.y
Random Forest 

891 samples
 28 predictor
  2 classes: 'Survived', 'Dead' 

No pre-processing
Resampling: Cross-Validated (10 fold, repeated 5 times) 
Summary of sample sizes: 803, 802, 802, 802, 802, 802, ... 
Addtional sampling using SMOTE

Resampling results across tuning parameters:

  mtry  ROC        Sens       Spec     
   5    0.8783818  0.6333782  0.9369966
  10    0.8821756  0.6854286  0.9129697
  15    0.8831274  0.6983025  0.9016498
  20    0.8814043  0.7129580  0.8910976
  25    0.8793606  0.7135462  0.8885455

ROC was used to select the optimal model using  the largest value.
The final value used for the model was mtry = 15.
plot(rfsmoteFit.y)

plot(rfsmoteFit.y$finalModel)

densityplot(rfsmoteFit.y,pch='|')

predict(rfsmoteFit.y,type = 'prob') -> train.rfsmoteFit.Probs
histogram(~Survived+Dead,train.rfsmoteFit.Probs)

Elastinet

glmnetFit
glmnet 

891 samples
 53 predictor
  2 classes: 'Survived', 'Dead' 

No pre-processing
Resampling: Cross-Validated (10 fold, repeated 5 times) 
Summary of sample sizes: 803, 802, 802, 802, 802, 802, ... 
Addtional sampling using SMOTE

Resampling results across tuning parameters:

  alpha  lambda      ROC        Sens       Spec     
  0.0    0.01000000  0.8624351  0.7269580  0.8875152
  0.0    0.01487179  0.8624351  0.7269580  0.8875152
  0.0    0.01974359  0.8624351  0.7269580  0.8875152
  0.0    0.02461538  0.8624351  0.7269580  0.8875152
  0.0    0.02948718  0.8624351  0.7269580  0.8875152
  0.0    0.03435897  0.8626287  0.7269580  0.8871515
  0.0    0.03923077  0.8629192  0.7269412  0.8871515
  0.0    0.04410256  0.8631763  0.7269076  0.8860539
  0.0    0.04897436  0.8633421  0.7263361  0.8856902
  0.0    0.05384615  0.8631602  0.7246218  0.8860539
  0.0    0.05871795  0.8632236  0.7234286  0.8856902
  0.0    0.06358974  0.8634279  0.7240168  0.8853266
  0.0    0.06846154  0.8634157  0.7240168  0.8838721
  0.0    0.07333333  0.8634152  0.7246218  0.8835017
  0.0    0.07820513  0.8633267  0.7252269  0.8838653
  0.0    0.08307692  0.8633870  0.7246723  0.8842290
  0.0    0.08794872  0.8632672  0.7264370  0.8838653
  0.0    0.09282051  0.8630221  0.7258487  0.8838653
  0.0    0.09769231  0.8630112  0.7246723  0.8835017
  0.0    0.10256410  0.8630108  0.7258487  0.8827744
  0.0    0.10743590  0.8629793  0.7270252  0.8820337
  0.0    0.11230769  0.8629057  0.7275966  0.8820337
  0.0    0.11717949  0.8629160  0.7264370  0.8816700
  0.0    0.12205128  0.8629367  0.7252605  0.8816700
  0.0    0.12692308  0.8628505  0.7246723  0.8813064
  0.0    0.13179487  0.8627742  0.7252437  0.8813064
  0.0    0.13666667  0.8626347  0.7240840  0.8816700
  0.0    0.14153846  0.8626660  0.7234790  0.8816700
  0.0    0.14641026  0.8624861  0.7228908  0.8816700
  0.0    0.15128205  0.8623359  0.7205378  0.8809360
  0.0    0.15615385  0.8622288  0.7211261  0.8805724
  0.0    0.16102564  0.8621643  0.7211092  0.8798451
  0.0    0.16589744  0.8620677  0.7199496  0.8791111
  0.0    0.17076923  0.8620130  0.7193782  0.8787475
  0.0    0.17564103  0.8620221  0.7193782  0.8791111
  0.0    0.18051282  0.8620338  0.7193782  0.8791111
  0.0    0.18538462  0.8620142  0.7193782  0.8780202
  0.0    0.19025641  0.8620445  0.7182017  0.8765657
  0.0    0.19512821  0.8619043  0.7170252  0.8765657
  0.0    0.20000000  0.8618487  0.7152773  0.8758384
  0.1    0.01000000  0.8600372  0.7241176  0.8878519
  0.1    0.01487179  0.8615477  0.7264538  0.8896768
  0.1    0.01974359  0.8624891  0.7241345  0.8875017
  0.1    0.02461538  0.8631904  0.7223866  0.8878653
  0.1    0.02948718  0.8635738  0.7270252  0.8871246
  0.1    0.03435897  0.8640134  0.7281513  0.8867542
  0.1    0.03923077  0.8642901  0.7257983  0.8860269
  0.1    0.04410256  0.8644447  0.7257983  0.8852997
  0.1    0.04897436  0.8644893  0.7246218  0.8852997
  0.1    0.05384615  0.8647542  0.7234622  0.8845724
  0.1    0.05871795  0.8648624  0.7205378  0.8849360
  0.1    0.06358974  0.8646418  0.7205378  0.8849360
  0.1    0.06846154  0.8645368  0.7211261  0.8849360
  0.1    0.07333333  0.8643896  0.7193950  0.8842020
  0.1    0.07820513  0.8643594  0.7176303  0.8842020
  0.1    0.08307692  0.8642748  0.7141008  0.8845589
  0.1    0.08794872  0.8640778  0.7135294  0.8841953
  0.1    0.09282051  0.8636771  0.7123697  0.8834815
  0.1    0.09769231  0.8635362  0.7129580  0.8823906
  0.1    0.10256410  0.8631628  0.7123697  0.8805657
  0.1    0.10743590  0.8628222  0.7123529  0.8798316
  0.1    0.11230769  0.8625770  0.7106050  0.8794680
  0.1    0.11717949  0.8622052  0.7111933  0.8780135
  0.1    0.12205128  0.8619550  0.7111933  0.8772795
  0.1    0.12692308  0.8616472  0.7100336  0.8765522
  0.1    0.13179487  0.8616144  0.7088908  0.8761886
  0.1    0.13666667  0.8614748  0.7083025  0.8747340
  0.1    0.14153846  0.8612211  0.7082857  0.8747340
  0.1    0.14641026  0.8611024  0.7076975  0.8743636
  0.1    0.15128205  0.8609678  0.7065210  0.8740000
  0.1    0.15615385  0.8605709  0.7059328  0.8732727
  0.1    0.16102564  0.8604414  0.7059496  0.8725455
  0.1    0.16589744  0.8602385  0.7048067  0.8721751
  0.1    0.17076923  0.8599341  0.7036471  0.8725387
  0.1    0.17564103  0.8598033  0.7042353  0.8718114
  0.1    0.18051282  0.8595210  0.7036639  0.8707205
  0.1    0.18538462  0.8591656  0.7024874  0.8703569
  0.1    0.19025641  0.8589091  0.7018992  0.8699933
  0.1    0.19512821  0.8584617  0.7013277  0.8703569
  0.1    0.20000000  0.8581420  0.7013277  0.8692660
  0.2    0.01000000  0.8591220  0.7280672  0.8882020
  0.2    0.01487179  0.8604820  0.7245882  0.8903906
  0.2    0.01974359  0.8618651  0.7228571  0.8911178
  0.2    0.02461538  0.8620406  0.7228908  0.8892997
  0.2    0.02948718  0.8620432  0.7217143  0.8889360
  0.2    0.03435897  0.8622358  0.7234958  0.8889428
  0.2    0.03923077  0.8622652  0.7223361  0.8885859
  0.2    0.04410256  0.8620627  0.7229412  0.8889495
  0.2    0.04897436  0.8620116  0.7188235  0.8874949
  0.2    0.05384615  0.8619238  0.7153109  0.8864040
  0.2    0.05871795  0.8619083  0.7147227  0.8856700
  0.2    0.06358974  0.8614219  0.7141513  0.8853064
  0.2    0.06846154  0.8613769  0.7094790  0.8845724
  0.2    0.07333333  0.8613267  0.7089076  0.8849360
  0.2    0.07820513  0.8613301  0.7071429  0.8842088
  0.2    0.08307692  0.8613348  0.7065546  0.8823906
  0.2    0.08794872  0.8612440  0.7036471  0.8805724
  0.2    0.09282051  0.8607954  0.7036639  0.8791111
  0.2    0.09769231  0.8604293  0.7007563  0.8765657
  0.2    0.10256410  0.8599402  0.7007563  0.8747475
  0.2    0.10743590  0.8591161  0.7025378  0.8736431
  0.2    0.11230769  0.8580974  0.7019496  0.8721818
  0.2    0.11717949  0.8576971  0.7025042  0.8710774
  0.2    0.12205128  0.8571679  0.7025042  0.8703502
  0.2    0.12692308  0.8567174  0.7024874  0.8688956
  0.2    0.13179487  0.8561708  0.7007395  0.8656229
  0.2    0.13666667  0.8550908  0.7013277  0.8648956
  0.2    0.14153846  0.8544119  0.7007395  0.8645320
  0.2    0.14641026  0.8540218  0.7007563  0.8641684
  0.2    0.15128205  0.8534856  0.7007563  0.8638047
  0.2    0.15615385  0.8528506  0.7001681  0.8627138
  0.2    0.16102564  0.8523328  0.6984034  0.8627138
  0.2    0.16589744  0.8514521  0.6984034  0.8619865
  0.2    0.17076923  0.8508972  0.6978151  0.8598047
  0.2    0.17564103  0.8506594  0.6972269  0.8594411
  0.2    0.18051282  0.8500216  0.6978151  0.8583434
  0.2    0.18538462  0.8495585  0.6972437  0.8572458
  0.2    0.19025641  0.8490212  0.6966723  0.8561549
  0.2    0.19512821  0.8488122  0.6955126  0.8557912
  0.2    0.20000000  0.8477981  0.6949244  0.8547003
  0.4    0.01000000  0.8608629  0.7170924  0.8856835
  0.4    0.01487179  0.8630875  0.7188235  0.8875017
  0.4    0.01974359  0.8635522  0.7235126  0.8882290
  0.4    0.02461538  0.8638852  0.7241008  0.8863973
  0.4    0.02948718  0.8640961  0.7246387  0.8874882
  0.4    0.03435897  0.8636815  0.7205882  0.8878519
  0.4    0.03923077  0.8634645  0.7188403  0.8867542
  0.4    0.04410256  0.8625804  0.7165210  0.8845589
  0.4    0.04897436  0.8610777  0.7129916  0.8845589
  0.4    0.05384615  0.8603462  0.7106218  0.8812727
  0.4    0.05871795  0.8593766  0.7100168  0.8783569
  0.4    0.06358974  0.8586905  0.7106387  0.8758047
  0.4    0.06846154  0.8577189  0.7083193  0.8739865
  0.4    0.07333333  0.8561190  0.7071765  0.8707138
  0.4    0.07820513  0.8539432  0.7042521  0.8692525
  0.4    0.08307692  0.8520797  0.7048571  0.8674276
  0.4    0.08794872  0.8510941  0.7054454  0.8652391
  0.4    0.09282051  0.8498438  0.7060168  0.8612391
  0.4    0.09769231  0.8489821  0.7042521  0.8590572
  0.4    0.10256410  0.8485292  0.7054286  0.8543232
  0.4    0.10743590  0.8478570  0.7042521  0.8535960
  0.4    0.11230769  0.8474843  0.7013277  0.8514074
  0.4    0.11717949  0.8474952  0.7001345  0.8514141
  0.4    0.12205128  0.8472912  0.6995462  0.8503232
  0.4    0.12692308  0.8465502  0.6989580  0.8499596
  0.4    0.13179487  0.8458615  0.6977983  0.8495960
  0.4    0.13666667  0.8460465  0.6960336  0.8499596
  0.4    0.14153846  0.8456487  0.6936807  0.8510640
  0.4    0.14641026  0.8457106  0.6919328  0.8510640
  0.4    0.15128205  0.8463243  0.6884034  0.8514276
  0.4    0.15615385  0.8466792  0.6872269  0.8514276
  0.4    0.16102564  0.8467969  0.6860840  0.8514276
  0.4    0.16589744  0.8465443  0.6860840  0.8517912
  0.4    0.17076923  0.8460047  0.6854958  0.8521549
  0.4    0.17564103  0.8456889  0.6843193  0.8521549
  0.4    0.18051282  0.8452321  0.6843193  0.8521549
  0.4    0.18538462  0.8443937  0.6831765  0.8525185
  0.4    0.19025641  0.8439948  0.6831765  0.8525185
  0.4    0.19512821  0.8432182  0.6831765  0.8525185
  0.4    0.20000000  0.8429886  0.6820000  0.8525185
  0.6    0.01000000  0.8615146  0.7217311  0.8889428
  0.6    0.01487179  0.8625244  0.7234118  0.8911380
  0.6    0.01974359  0.8627385  0.7234622  0.8911246
  0.6    0.02461538  0.8630850  0.7211765  0.8900202
  0.6    0.02948718  0.8622451  0.7194286  0.8860000
  0.6    0.03435897  0.8620347  0.7135966  0.8830842
  0.6    0.03923077  0.8608737  0.7077311  0.8808956
  0.6    0.04410256  0.8595263  0.7077647  0.8776229
  0.6    0.04897436  0.8580028  0.7071765  0.8750774
  0.6    0.05384615  0.8563695  0.7054454  0.8725253
  0.6    0.05871795  0.8546962  0.7048739  0.8641616
  0.6    0.06358974  0.8528297  0.7066050  0.8601549
  0.6    0.06846154  0.8511820  0.7071765  0.8568822
  0.6    0.07333333  0.8498130  0.7089244  0.8521481
  0.6    0.07820513  0.8489291  0.7083361  0.8488687
  0.6    0.08307692  0.8492258  0.7071597  0.8488620
  0.6    0.08794872  0.8491236  0.7054118  0.8488620
  0.6    0.09282051  0.8492666  0.7018824  0.8488620
  0.6    0.09769231  0.8486469  0.7001176  0.8492256
  0.6    0.10256410  0.8485608  0.6954790  0.8506869
  0.6    0.10743590  0.8486213  0.6937143  0.8506869
  0.6    0.11230769  0.8478946  0.6931261  0.8506869
  0.6    0.11717949  0.8466370  0.6901849  0.8506869
  0.6    0.12205128  0.8461776  0.6860840  0.8517912
  0.6    0.12692308  0.8455451  0.6860840  0.8517912
  0.6    0.13179487  0.8436514  0.6854958  0.8517912
  0.6    0.13666667  0.8430642  0.6837647  0.8521549
  0.6    0.14153846  0.8423842  0.6831765  0.8521549
  0.6    0.14641026  0.8418510  0.6825882  0.8525185
  0.6    0.15128205  0.8407780  0.6820000  0.8525185
  0.6    0.15615385  0.8404541  0.6814118  0.8525185
  0.6    0.16102564  0.8401007  0.6814118  0.8525185
  0.6    0.16589744  0.8396466  0.6814118  0.8525185
  0.6    0.17076923  0.8391832  0.6814118  0.8525185
  0.6    0.17564103  0.8392284  0.6814118  0.8525185
  0.6    0.18051282  0.8390840  0.6814118  0.8525185
  0.6    0.18538462  0.8388220  0.6814118  0.8525185
  0.6    0.19025641  0.8389099  0.6814118  0.8525185
  0.6    0.19512821  0.8367532  0.6814118  0.8525185
  0.6    0.20000000  0.8350971  0.6814118  0.8525185
 [ reached getOption("max.print") -- omitted 80 rows ]

ROC was used to select the optimal model using  the largest value.
The final values used for the model were alpha = 0.1 and lambda = 0.05871795.
plot(glmnetFit,plotType='level')

plot(varImp(glmnetFit))

densityplot(glmnetFit,pch='|')

predict(glmnetFit,type = 'prob') -> train.glmnet.Probs
histogram(~Survived+Dead,train.glmnet.Probs)

Compare models

re <-
    resamples(
    x = list(
    xgb = xgbFit,
    xgbsmote = xgbsmoteFit,
    xgbdown = xgbdownFit,
    rf = rfFit.y,
    rfsmote = rfsmoteFit.y,
    gbm = boostFit,
    elastinet=glmnetFit,
    crf = crfFit,
    crfFit_class= crfFit_class,
    xgbsmall=xgbsmallFit,
    cforest=cforestFit
    )
    )
# summary(re)
bwplot(re)

dotplot(re)

# summary(diff(re))

Calibration curves…

simulatedTrain <- data.frame(Class = train.imp$Survived)
simulatedTrain$rf = predict(rfFit.y,type = 'prob')[[1]]
simulatedTrain$rfsmote = predict(rfsmoteFit.y,type = 'prob')[[1]]
simulatedTrain$xgb = predict(xgbFit,type = 'prob')[[1]]
simulatedTrain$xgbsmote = predict(xgbsmoteFit,type = 'prob')[[1]]
simulatedTrain$boost = predict(boostFit,type = 'prob')[[1]]
calCurve <- calibration(x = Class~rf+rfsmote+xgb+xgbsmote+boost,data = simulatedTrain)
xyplot(calCurve,auto.key=list(columns=3))

Calibrating probabilities

boostsigmoidCal <- glm(relevel(Class,ref='Dead')~boost,simulatedTrain,family = 'binomial')
coef(summary(boostsigmoidCal))
             Estimate Std. Error   z value     Pr(>|z|)
(Intercept) -3.393991  0.1992172 -17.03664 4.392812e-65
boost        7.063846  0.4064620  17.37886 1.193056e-67
simulatedTrain$boostSig = predict(boostsigmoidCal,type = 'response')
xgbsmotesigmoidCal <- glm(relevel(Class,ref='Dead')~xgbsmote,simulatedTrain,family = 'binomial')
coef(summary(xgbsmotesigmoidCal))
             Estimate Std. Error   z value     Pr(>|z|)
(Intercept) -3.468413  0.2016514 -17.20004 2.653386e-66
xgbsmote     9.205386  0.5945264  15.48356 4.479596e-54
simulatedTrain$xgbsmoteSig = predict(xgbsmotesigmoidCal,type = 'response')
calibration(x = Class~boost+boostSig,data = simulatedTrain) %>%
    xyplot(auto.key=list(columns=2))

calibration(x = Class~xgbsmote+xgbsmoteSig,data = simulatedTrain) %>%
    xyplot(auto.key=list(columns=2))

Test Set Evaluation

Create test set

test.imp <- test.raw
#Embarked
test.imp$Embarked[is.na(test.imp$Embarked)]='S'
#Title
test.raw$title <- str_extract(pattern = '[a-zA-Z]+(?=\\.)',string = test.raw$Name)
#test.raw$title <- as.factor(test.raw$title)
test.imp$title <- as.character(test.raw$title)
test.imp$title[test.imp$title %in% c('Capt','Col','Major')] <- 'Officer'
test.imp$title[test.imp$title %in% c('Don','Dr','Rev','Sir','Jonkheer','Countess','Lady','Dona')] <- 'Royalty'
test.imp$title[test.imp$title %in% c('Mrs','Mme')] <- 'Mrs'
test.imp$title[test.imp$title %in% c('Ms','Mlle')] <- 'Miss'
test.imp$title <- as.factor(test.imp$title)
#Missing age
missing.age <- test.imp %>% filter(is.na(Age))
age.predicted <- predict(rfFit, newdata = missing.age)
test.imp$Age[is.na(test.imp$Age)] <- age.predicted
test.imp$Age[test.imp$title=='Master' & test.imp$Age > 20] <- 4
#Child
test.imp$child <- 0
test.imp$child[test.imp$Age<18] <- 1
test.imp$almostadult <- as.numeric(between(test.imp$Age,16,18))
#Young/old
test.imp$Young <- ifelse(test.imp$Age<10,1,0)
test.imp$Seniors <- ifelse(test.imp$Age>60,1,0)
#Family Related
test.imp$TotalFam <- test.imp$SibSp + test.imp$Parch + 1
test.imp$Name <- NULL
test.imp$LargeParCh <- as.numeric(test.imp$Parch>=3)
test.imp$LargeSibSp <- as.numeric(test.imp$SibSp>=3)
test.imp$Single <- ifelse(test.imp$TotalFam==1,1,0)
test.imp$Couple <- ifelse(test.imp$TotalFam==2,1,0)
test.imp$Family <- ifelse(test.imp$TotalFam>4,1,0)
#Cabin & Deck
test.imp$CabinMissing <- as.numeric(is.na(test.raw$Cabin))
test.imp$CabinCode <- map_chr(test.raw$Cabin,~str_split(string = .x,pattern = '')[[1]][1])
test.imp$CabinCode[is.na(test.imp$CabinCode)] <- 'U'
test.imp$CabinNum <- as.numeric(map_chr(test.raw$Cabin,~str_split(string = .x,pattern = '[a-zA-Z]')[[1]][2]))
test.imp$CabinNum <- map_int(test.imp$CabinNum, ~as.integer(str_split(.x,pattern = '',simplify = T)[1][1]))
test.imp$CabinNum[is.na(test.imp$CabinNum)] <- 0
test.imp$CabinCode <- factor(
    x = test.imp$CabinCode,
    levels = unique(train.imp$CabinCode)
)
test.imp$TopDeck <- ifelse(test.imp$CabinCode %in% c('A','B'),1,0)
test.imp$MidDeck <- ifelse(test.imp$CabinCode %in% c('C','D'),1,0)
test.imp$LowerDeck <- ifelse(test.imp$TopDeck==0 & test.imp$MidDeck ==0 ,1,0)
test.imp$NumberofCabins <- map_int(test.raw$Cabin,~str_split(string = .x,pattern = ' ')[[1]] %>% length)
test.imp$Cabin <- NULL
# Ticket
test.imp %<>%
    mutate(
      Ticket = str_to_upper(Ticket) %>%
          str_replace_all(pattern = regex(pattern = '[.\\/]'),replacement = ''),
      TicketNum = str_extract(Ticket,pattern = regex('([0-9]){3,}')),
      TicketNumStart = map_int(TicketNum,~as.integer(str_split(.x,pattern = '',simplify = T)[1])),
      TicketNumLen = map_int(TicketNum,~dim(str_split(.x,pattern = '',simplify = T))[2]),
      TicketChar = str_extract(Ticket,pattern = regex('^[a-zA-Z/\\.]+'))
      ) %>%
    mutate(
        TicketChar = map_chr(.x=TicketChar,
                             .f=~str_split(string=.x, pattern = '',simplify = T)[1])
        ) %>%  
    mutate(
      TicketChar = ifelse(is.na(TicketChar),'U',TicketChar),
      TicketNumStart = ifelse(is.na(TicketNumStart),0,TicketNumStart),
      TicketNumLen = ifelse(is.na(TicketNumLen),0,TicketNumLen),
    )
test.imp$Ticket <- NULL
test.imp$TicketNum <- NULL
#Fare
test.imp$Fare[is.na(test.imp$Fare)] <- 14.4542
# test.imp$Fare[test.imp$Fare>232] <- 232

Predict test results

xgbsmotesigmoidCal

Call:  glm(formula = relevel(Class, ref = "Dead") ~ xgbsmote, family = "binomial", 
    data = simulatedTrain)

Coefficients:
(Intercept)     xgbsmote  
     -3.468        9.205  

Degrees of Freedom: 890 Total (i.e. Null);  889 Residual
Null Deviance:      1187 
Residual Deviance: 491.9    AIC: 495.9

Combined data… ensemble voting model…

d <- data.frame(boostPred,xgbPred,rfPred,xgbsmotePred,rfsmotePred,boostSigPred,crfPred,crfClassPred)
map_df(d,~as.numeric(.x)*-1+2) -> d
d %<>% 
    mutate(Avg=rowMeans(.),
           Sums = rowSums(.),
           EnsembleVote = as.numeric(Sums>4))
ensemblePred <- d$EnsembleVote

Write results

PID <-
    readData(Titanic.path,
    test.data.file,
    test.column.types,
    missing.types)
PID <- PID$PassengerId
for(m in ls(pattern = 'Pred')) {
    write.csv(
    x = data.frame(
    PassengerId = PID,
    Survived = as.numeric(eval(parse(text = m))) * -1 + 2
    ),
    file = paste0(m,'.csv'),
    row.names = F
    )
}

Conclusions

Misc - delete later…

d %<>% 
    mutate(Avg=rowMeans(.),
           Sums = rowSums(.),
           EnsembleVote = as.numeric(Sums>4))
Error in d %<>% mutate(Avg = rowMeans(.), Sums = rowSums(.), EnsembleVote = as.numeric(Sums >  : 
  could not find function "%<>%"

  1. I think this approach depends on the academic background and the industry of the analyst. Prof Srinivasan, and my mentor at work both have strong statistical academic backgrounds, and both believe in thorough EDA of the data. I’ve also noticed this approach from individuals in the banking & insurance industry - perhaps due to regulatory requirements. On the other hand, folks trained in computer science and algorithmic data science tend to underplay the importance of thorough EDA.

  2. To iterate variable names in ggplot, use ggplot(...)+aes_string(...) in place of ggplot(...,aes(...)).

  3. Read more about beanplots here: https://cran.r-project.org/web/packages/beanplot/vignettes/beanplot.pdf

LS0tCnRpdGxlOiAiS2FnZ2xlIFRpdGFuaWMgQ29tcGV0aXRpb24gLSBEYXRhIEV4cGxvcmF0aW9uICYgTW9kZWwgQnVpbGRpbmciCmF1dGhvcjogJ1JhaHVsIFNhbmdvbGUnCmRhdGU6IEF1ZyAzMSwgMjAxNwpvdXRwdXQ6CiAgaHRtbF9ub3RlYm9vazoKICAgIGNvZGVfZm9sZGluZzogaGlkZQogICAgY29sbGFwc2VkOiBubwogICAgZmlnX2hlaWdodDogMwogICAgZmlnX3dpZHRoOiA1CiAgICBoaWdobGlnaHQ6IHB5Z21lbnRzCiAgICB0aGVtZTogam91cm5hbAogICAgdG9jOiB5ZXMKICAgIHRvY19mbG9hdDogeWVzCi0tLQojIE9iamVjdGl2ZXMKCjEuIEVuZCB0byBlbmQgYW5hbHlzaXMgdXNpbmcgUgoyLiBMZWFybiB0aGUgY2FyZXQgcGFja2FnZSBmb3IgTUwKMy4gTGVhcm4gdG8gcHJlc2VudCB0aGUgY2FzZSB1c2luZyBSIE5vdGVib29rcwoKKioqCgojIFJlYWQgaW4gdGhlIGRhdGFzZXQKSSBzdG9yZWQgdGhlIHJhdyBmaWxlcyBvbiBHaXRodWIsIHNvIEkgdXNlZCBbUkN1cmxdKGh0dHBzOi8vY3Jhbi5yLXByb2plY3Qub3JnL3dlYi9wYWNrYWdlcy9SQ3VybC9pbmRleC5odG1sKSB3aXRoIFtXZWhybGV5J3MgbWV0aG9kXShodHRwczovL2dpdGh1Yi5jb20vd2VocmxleS93ZWhybGV5LmdpdGh1Yi5pby9ibG9iL21hc3Rlci9TT1VQVE9OVVRTLm1kKSB0aGF0IHV0aWxpemVzIHJlYWQuY3N2IHRvIHRoZSBmdWxsZXN0LiBJdCdzIG9uZSBvZiB0aGUgYmVzdCB3YXlzIEkndmUgZm91bmQgdG8gcmVhZCBpbiBkYXRhIGFuZCBhbHNvIHNldCBkYXRhLXR5cGVzIGF0IHRoZSBzYW1lIHRpbWUuIEhlJ3MgZG9uZSBhIGdyZWF0IGpvYiBvbiB0aGF0IGZ1bmN0aW9uLiBUaGUgZGF0YXNldCBjb250YWlucyBvbmUgSUQgdmFyaWFibGUsIG9uZSByZXNwb25zZSB2YXJpYWJsZSBhbmQgdGVuIHByZWRpY3RvciB2YXJpYWJsZXMuCgpgYGB7ciwgbWVzc2FnZT1GQUxTRSwgd2FybmluZz1GQUxTRX0KbGlicmFyeShSQ3VybCxxdWlldGx5ID0gVCkKbGlicmFyeSh0aWR5dmVyc2UscXVpZXRseSA9IFQpCmxpYnJhcnkoZ2dwbG90MixxdWlldGx5ID0gVCkKbGlicmFyeShncmlkRXh0cmEscXVpZXRseSA9IFQpCmxpYnJhcnkoQW1lbGlhLHF1aWV0bHkgPSBUKQpsaWJyYXJ5KGJlYW5wbG90LHF1aWV0bHkgPSBUKQpsaWJyYXJ5KGNhcmV0LHF1aWV0bHkgPSBUKQpsaWJyYXJ5KHN0cmluZ3IscXVpZXRseSA9IFQpCmxpYnJhcnkocGFydHksIHF1aWV0bHkgPSBUKQojIGxpYnJhcnkocmF0dGxlLCBxdWlldGx5ID0gVCkKCnJlYWREYXRhIDwtIGZ1bmN0aW9uKHBhdGgubmFtZSwgZmlsZS5uYW1lLCBjb2x1bW4udHlwZXMsIG1pc3NpbmcudHlwZXMpIHsKICAgIGd1cmwgPC0gcGFzdGUocGF0aC5uYW1lLGZpbGUubmFtZSxzZXA9IiIpCiAgICBkb3dubG9hZC5maWxlKGd1cmwsZmlsZS5uYW1lLG1ldGhvZD0iY3VybCIscXVpZXQgPSBUKQogICAgdGJsX2RmKHJlYWQuY3N2KGZpbGUubmFtZSxjb2xDbGFzc2VzPWNvbHVtbi50eXBlcywKICAgICAgICAgICAgIG5hLnN0cmluZ3M9bWlzc2luZy50eXBlcykpCn0KClRpdGFuaWMucGF0aCA8LSAiaHR0cHM6Ly9yYXcuZ2l0aHVidXNlcmNvbnRlbnQuY29tL3JzYW5nb2xlL1RpdGFuaWMvbWFzdGVyLyIKdHJhaW4uZGF0YS5maWxlIDwtICJ0cmFpbi5jc3YiCnRlc3QuZGF0YS5maWxlIDwtICJ0ZXN0LmNzdiIKbWlzc2luZy50eXBlcyA8LSBjKCJOQSIsICIiKQp0cmFpbi5jb2x1bW4udHlwZXMgPC0gYygnaW50ZWdlcicsICAgIyBQYXNzZW5nZXJJZAogICAgICAgICAgICAgICAgICAgICAgICAnZmFjdG9yJywgICAgIyBTdXJ2aXZlZAogICAgICAgICAgICAgICAgICAgICAgICAnZmFjdG9yJywgICAgIyBQY2xhc3MKICAgICAgICAgICAgICAgICAgICAgICAgJ2NoYXJhY3RlcicsICMgTmFtZQogICAgICAgICAgICAgICAgICAgICAgICAnZmFjdG9yJywgICAgIyBTZXgKICAgICAgICAgICAgICAgICAgICAgICAgJ251bWVyaWMnLCAgICMgQWdlCiAgICAgICAgICAgICAgICAgICAgICAgICdpbnRlZ2VyJywgICAjIFNpYlNwCiAgICAgICAgICAgICAgICAgICAgICAgICdpbnRlZ2VyJywgICAjIFBhcmNoCiAgICAgICAgICAgICAgICAgICAgICAgICdjaGFyYWN0ZXInLCAjIFRpY2tldAogICAgICAgICAgICAgICAgICAgICAgICAnbnVtZXJpYycsICAgIyBGYXJlCiAgICAgICAgICAgICAgICAgICAgICAgICdjaGFyYWN0ZXInLCAjIENhYmluCiAgICAgICAgICAgICAgICAgICAgICAgICdmYWN0b3InICAgICAjIEVtYmFya2VkCikKCnRlc3QuY29sdW1uLnR5cGVzIDwtIHRyYWluLmNvbHVtbi50eXBlc1stMl0gICAgICMgIyBubyBTdXJ2aXZlZCBjb2x1bW4gaW4gdGVzdC5jc3YKdHJhaW4ucmF3IDwtIHJlYWREYXRhKFRpdGFuaWMucGF0aCwgdHJhaW4uZGF0YS5maWxlLHRyYWluLmNvbHVtbi50eXBlcyxtaXNzaW5nLnR5cGVzKQp0ZXN0LnJhdyA8LSByZWFkRGF0YShUaXRhbmljLnBhdGgsIHRlc3QuZGF0YS5maWxlLHRlc3QuY29sdW1uLnR5cGVzLG1pc3NpbmcudHlwZXMpCgpwcmVwX2RhdGEgPC0gZnVuY3Rpb24oRCkgewogICAgaWYgKCFpcy5udWxsKEQkU3Vydml2ZWQpKSB7CiAgICAgICAgRCRTdXJ2aXZlZCA8LSBmYWN0b3IoRCRTdXJ2aXZlZCwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICBsZXZlbHMgPSBjKDEsIDApLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgIGxhYmVscyA9IGMoJ1N1cnZpdmVkJywgJ0RlYWQnKSkKICAgICAgICB9CiAgICBEJFBjbGFzcyA8LSBmYWN0b3IoRCRQY2xhc3MsCiAgICAgICAgICAgICAgICAgICAgICAgbGV2ZWxzID0gYygxLCAyLCAzKSwKICAgICAgICAgICAgICAgICAgICAgICBsYWJlbHMgPSBjKCdQMScsICdQMicsICdQMycpKQogICAgRCRQYXNzZW5nZXJJZCA8LSBOVUxMCiAgICBECn0KCnRyYWluLnJhdyA8LSBwcmVwX2RhdGEodHJhaW4ucmF3KQp0ZXN0LnJhdyA8LSBwcmVwX2RhdGEodGVzdC5yYXcpCnN0cih0cmFpbi5yYXcpCmBgYAoKKioqCgojIE1pc3NpbmcgdmFsdWVzIGFuYWx5c2lzCgpRdWljayBpbnZlc3RpZ2F0aW9uIG9mIG1pc3NpbmcgdmFsdWVzIGNhbiBiZSBkb25lIHVzaW5nIHRoZSBgY29tcGxldGUuY2FzZXMoKWAsIGFuZCBtb3JlIHRob3JvdWdoIGdyYXBoaWNhbCBzdW1tYXJ5IGNhbiBiZSBkb25lIHVzaW5nIEFtZWxpYS4gT3ZlcmFsbCwgNzklIG9mIHRoZSBvYnNlcnZhdGlvbnMgaGF2ZSAqc29tZSogbWlzc2luZyBkYXRhLgoKYGBge3J9CiNDb21wbGV0ZSBjYXNlcyAocGVyY2VudGFnZXMpCnJvdW5kKHByb3AudGFibGUodGFibGUoY29tcGxldGUuY2FzZXModHJhaW4ucmF3KSkpLDIpCmBgYAoKQW1lbGlhIGxldHMgdXMgZ3JhcGhpY2FsbHkgaW52ZXN0aWdhdGUgd2hpY2ggdmFyaWFibGVzIGhhdmUgbWlzc2luZyBkYXRhLiBgcHVycjo6bWFwX3h4eCgpYCBnaXZlcyB0aGlzIHNhbWUgaW5mb3JtYXRpb24gbnVtZXJpY2FsbHkgaW4gYSBzdWNjaW50IGZhc2hpb24uCmBgYHtyLCBtZXNzYWdlPUZBTFNFLCB3YXJuaW5nPUZBTFNFfQptaXNzbWFwKHRyYWluLnJhdywgbWFpbj0nTWlzc2luZyBWYWx1ZXMgQW5hbHlzaXMgdXNpbmcgQW1lbGlhIG9yZGVyZWQgYnkgJSBtaXNzaW5nJywgY29sPWMoJ3JlZCcsICdncmF5JyksbGVnZW5kID0gRixyYW5rLm9yZGVyID0gVCkKI01pc3NpbmcgY2FzZXMgKG51bWJlcnMpOgptYXBfaW50KHRyYWluLnJhdyx+c3VtKGlzLm5hKC54KSkpCiNNaXNzaW5nIGNhc2VzIChwZXJjZW50YWdlcyk6CnJvdW5kKG1hcF9kYmwodHJhaW4ucmF3LH5zdW0oaXMubmEoLngpKS9sZW5ndGgoLngpKSwyKQpgYGAKCkNhYmluIGhhcyBhIGxhcmdlIG51bWJlciBvZiBtaXNzaW5nIHZhbHVlcyAoNzclIG1pc3NpbmcpLiBJbXB1dGluZyB0aGlzIHZhcmlhYmxlIG1heSBwcm92ZSBjaGFsbGVuZ2luZyBvciBldmVuIHVzZWxlc3MuIEFnZSAoMTkuOSUgbWlzc2luZykgYW5kIEVtYmFya2VkICgwLjIlKSBtaXNzaW5nIGFyZSBtdWNoIG1vcmUgbWFuYWdhYmxlLgoKKioqCgojIEVEQQoKVGhlIGZpcnN0IHN0ZXAgaW4gdGhlIGFuYWx5c2lzIGlzIHRvIGV4cGxvcmUgdGhlIGRhdGEgbnVtZXJpY2FsbHkgYW5kIGdyYXBoaWNhbGx5LiBJIGFsd2F5cyBzcGxpdCB1cCBteSBFREEgaW52ZXN0aWdhdGlvbiBhcyBmb2xsb3dzOgoKKiBUYXJnZXQgVmFyaWFibGUKKiBQcmVkaWN0b3IgVmFyaWFibGVzCiAgICArIFVuaXZhcmlhdGUKICAgICsgQml2YXJpYXRlCiAgICArIE11bHRpdmFyaWF0ZQoKVGhpcyBnaXZlcyBtZSBhIHN0cnVjdHVyZWQgYXBwcm9hY2ggdG93YXJkcyBsYXJnZXIgZGF0YXNldHMuIE15IFtwcm9mZXNzb3JdKGh0dHA6Ly93d3cuc3lhbWFsYXNyaW5pdmFzYW4uY29tLykgYXQgTm9ydGh3ZXN0ZXJuIHRhdWdodCBtZSB0byBhbHdheXMgY29tcGxldGUgYSB0aG9yb3VnaCBpbnRpbWF0ZSBudW1lcmljICYgZ3JhcGhpY2FsIEVEQSBvbiB0aGUgZGF0YSwgbm8gbWF0dGVyIGhvdyBsYXJnZSB0aGUgZGF0YSBbXjFdLiBbQW5zY29tYmVdKGh0dHA6Ly93d3cuanN0b3Iub3JnL3N0YWJsZS8yNjgyODk5KSAoMTk3MykgY2xlYXJseSBzaG93cyB0aGUgaW1wb3J0YW5jZSBvZiBncmFwaGljYWwgYW5hbHlzZXMuCgpbXjFdOiBJIHRoaW5rIHRoaXMgYXBwcm9hY2ggZGVwZW5kcyBvbiB0aGUgYWNhZGVtaWMgYmFja2dyb3VuZCBhbmQgdGhlIGluZHVzdHJ5IG9mIHRoZSBhbmFseXN0LiBQcm9mIFNyaW5pdmFzYW4sIGFuZCBteSBtZW50b3IgYXQgd29yayBib3RoIGhhdmUgc3Ryb25nIHN0YXRpc3RpY2FsIGFjYWRlbWljIGJhY2tncm91bmRzLCBhbmQgYm90aCBiZWxpZXZlIGluIHRob3JvdWdoIEVEQSBvZiB0aGUgZGF0YS4gSSd2ZSBhbHNvIG5vdGljZWQgdGhpcyBhcHByb2FjaCBmcm9tIGluZGl2aWR1YWxzIGluIHRoZSBiYW5raW5nICYgaW5zdXJhbmNlIGluZHVzdHJ5IC0gcGVyaGFwcyBkdWUgdG8gcmVndWxhdG9yeSByZXF1aXJlbWVudHMuIE9uIHRoZSBvdGhlciBoYW5kLCBmb2xrcyB0cmFpbmVkIGluIGNvbXB1dGVyIHNjaWVuY2UgYW5kIGFsZ29yaXRobWljIGRhdGEgc2NpZW5jZSB0ZW5kIHRvIHVuZGVycGxheSB0aGUgaW1wb3J0YW5jZSBvZiB0aG9yb3VnaCBFREEuCgojIyBUYXJnZXQgVmFyaWFibGUKYFN1cnZpdmVkYCBpcyB0aGUgcmVzcG9uc2UgdmFyaWFibGUuIEFzIHdlIGNhbiBzZWUsIGEgbGFyZ2UgbWFqb3JpdHkgb2YgdGhlIHBhc3NlbmdlcnMgZGlkIG5vdCBzdXJ2aXZlIHRoZSBhY2NpZGVudC4gVGhlIHJlc3BvbnNlIHZhcmlhYmxlIGlzIGEgRmFsc2UvVHJ1ZSBib29sZWFuIHZhcmlhYmxlLiBUaHVzLCB0aGUgYW5hbHlzaXMgdGVjaG5pcXVlcyB1c2VkIGxhdGVyIHdpbGwgYmUgdGhvc2UgYXBwcm9wcmlhdGUgZm9yIGNsYXNzaWZpY2F0aW9uIHByb2JsZW1zLgpgYGB7cn0Kcm91bmQocHJvcC50YWJsZSh0YWJsZSh0cmFpbi5yYXckU3Vydml2ZWQpKSwyKQpgYGAKCioqKgoKIyMgUHJlZGljdG9yIFZhcmlhYmxlcyB7LnRhYnNldCAudGFic2V0LWZhZGV9CgojIyMgVW5pdmFyaWF0ZSAmIEJpdmFyaWF0ZQoKVGhlIGZpcnN0IHN0ZXAgaXMgdG8gbG9vayBhdCBldmVyeSB2YXJpYWJsZSBhdmFpbGFibGUuIEkgcHJlZmVyIHVzaW5nIHRoZSBgZ2dwbG90MmAgZnJhbWV3b3JrIGZvciBhbGwgdGhlIHZpc3VhbHMuCgojIyMjIENvbnRpbnVvdXMgVmFyaWFibGVzCgoqIGBBZ2VgIHNlZW1zIHRvIGhhdmUgYSBiaW1vZGFsIGRpc3RyaWJ1dGlvbiAtIHZlcnkgeW91bmcgY2hpbGRyZW4sIGFuZCB0aGVuIGRpcmVjdGx5IHlvdW5nIGFkdWx0cyB0byBtaWQtYWdlIHBlcnNvbnMuIFRoZSAybmQgbW9kZSBpcyByaWdodCBza2V3ZWQgd2l0aCBubyBvYnZpb3VzIG91dGxpZXJzLgoKKiBgRmFyZWAgY2VydGFpbmx5IHNob3dzIG1hbnkgb3V0bGllcnMgYmV5b25kIHRoZSB+JDIwMCBsZXZlbC4gQSBtYWpvcml0eSBvZiB0aGUgZmFyZXMgYXJlIDwkNTAsIHdoaWNoIG1ha2VzIHNlbnNlIHNpbmNlIGEgbWFqb3JpdHkgb2YgdGhlIHRyYXZlbGVycyBhcmUgYm91bmQgdG8gYmUgaW4gdGhlIDNyZCBwYXNzZW5nZXIgY2xhc3MuCgpgYGB7ciwgbWVzc2FnZT1GQUxTRSwgd2FybmluZz1GQUxTRX0KcDEgPC0gZ2dwbG90KGRhdGE9dHJhaW4ucmF3LGFlcyh4PUFnZSkpK2dlb21faGlzdG9ncmFtKGJpbnMgPSA0MCkKcDIgPC0gZ2dwbG90KGRhdGE9dHJhaW4ucmF3LGFlcyh4PUZhcmUpKStnZW9tX2hpc3RvZ3JhbShiaW5zID0gNDApCmdyaWQuYXJyYW5nZShwMSxwMikKYGBgCgpBcyB3ZSBjYW4gc2VlLCB0aGUgbWVkaWFuIGZhcmUgaXMgJDE0LjUsIHRoZSBtZWFuIGlzICQzMiwgYnV0IHRoZSBtYXggaXMgJDUxMi4gV2UnbGwgaW52ZXN0aWdhdGUgd2luem9yaXNpbmcgdGhpcyB2YXJpYWJsZSBpbiB0aGUgbGF0dGVyIHBhcnQuIFBlcmhhcHMgYSB0cmFuc2Zvcm1hdGlvbiB3aWxsIGFsc28gaGVscD8KCmBgYHtyfQpzdW1tYXJ5KHRyYWluLnJhdyRGYXJlKQpgYGAKCiMjIyMgQ2F0ZWdvcmljYWwgVmFyaWFibGVzCgpBIGdncGxvdCBjb21tYW5kIGlzIGl0ZXJhdGVkIG92ZXIgZm9yIHRoZSBjYXRlZ29yaWNhbCB2YXJpYWJsZXMuW14yXQoKW14yXTogVG8gaXRlcmF0ZSB2YXJpYWJsZSBuYW1lcyBpbiBnZ3Bsb3QsIHVzZSBgZ2dwbG90KC4uLikrYWVzX3N0cmluZyguLi4pYCBpbiBwbGFjZSBvZiBgZ2dwbG90KC4uLixhZXMoLi4uKSlgLgoKS2V5IHRha2V3YXlzIGZvciB0aGUgY2F0ZWdvcmljYWwgdmFyaWFibGVzOgoKMS4gYFBjbGFzc2A6IElmIHlvdSB3ZXJlIHRyYXZlbGluZyAxc3QgY2xhc3MsIHlvdSBoYXZlIHRoZSBoaWdoZXN0IGNoYW5jZSBvZiBzdXJ2aXZhbC4gQ291bGQgYmUgaW5kaWNhdGl2ZSBvZiBwcmVmZXJlbnRpYWwgdHJlYXRtZW50IHRvIHRob3NlIHdobyBwYWlkIG1vcmUsIGEgbGVzcyBwb2xpdGljYWxseSBjb3JyZWN0IGNsYXNzLXN0cmF0aWZpZWQgc29jaWV0eSwgYXMgd2VsbCBhcyB0aGUgZmFjdCB0aGF0IHRoZSAxc3QgY2xhc3MgcGFzc2VuZ2VycyBoYWQgY2FiaW5zIGF0IHRoZSB2ZXJ5IHRvcCBvZiB0aGUgc2hpcC4KMi4gYFBjbGFzc2A6IFBlcnNvbnMgdHJhdmVsaW5nIDNyZCBjbGFzcyBoYWQgdGhlIGhpZ2hlc3QgZmF0YWxpdHkgcmF0ZS4gM3JkIGNsYXNzIHBhc3NlbmdlcnMgaGFkIGNhYmlucyBkZWVwIGluIHRoZSBzaGlwLiBXaXRoIHRoZSByZWFzb25zIGdpdmUgaW4gKDEpLCB0aGlzIGNvdWxkIGhhdmUgY29udHJpYnV0ZWQgdG8gdGhlIGxvdyBzdXJ2aXZhbCByYXRlLgozLiBgU2V4YDogTWFsZXMgaGF2ZSBhIHZlcnkgaGlnaCBmYXRhbGl0eSByYXRlLiBTZWVtcyBsaWtlIHRoZSAnd29tZW4gYW5kIGNoaWxkcmVuJyBmaXJzdCBwb2xpY3kgd2FzIGZvbGxvd2VkIGR1cmluZyBldmFjdWF0aW9uLgo0LiBgU2liU3BgICYgYFBhcmNoYDogV2hhdCdzIGludGVyZXN0aW5nIGhlcmUgaXMsIGZvciBib3RoIHRoZXNlIHZhcmlhYmxlcywgYXQgbGV2ZWwgMCwgdGhlIGZhdGFsaXR5IHJhdGUgaXMgaGlnaGVyLiBBdCBsZXZlbHMgMSssIHRoZSBjaGFuY2VzIG9mIHN1cnZpdmFsIGFyZSBtdWNoIGJldHRlci4gQWdhaW4sIHRoaXMgY291bGQgcG9pbnQgdG8gdGhlICd3b21lbiAqYW5kIGNoaWxkcmVuKicgcG9saWN5IGJlaW5nIGZvbGxvd2VkLiAoT3IgcGVyaGFwcyB0aGVyZSB3ZXJlbid0IGFzIG1hbnkgZmFtaWxpZXMgd2l0aCBjaGlsZHJlbiBvbiBib2FyZCEpCjYuIGBFbWJhcmtlZGA6IFNvdXRoYW1wdG9uIGhhcyBhIGhpZ2hlciBmYXRhbGl0eSByYXRlIHRoYW4gQ2hlcmJvdXJnIG9yIFF1ZWVuc3Rvd24uIEEgY3Jvc3MtdGFidWxhdGlvbiBiZXR3ZWVuIGBFbWJhcmtlZGAgYW5kIGBQY2xhc3NgIHNob3dzIHRoYXQgNzIlIG9mIHRoZSAzcmQgY2xhc3MgcGFzc2VuZ2VycyBhbmQgODklIG9mIHRoZSAybmQgY2xhc3MgcGFzc2VuZ2VycyBib2FyZGVkIGF0IFNvdXRoYW1wdG9uLiBUaGlzIGppdmVzIHdpdGggdGhlIG9ic2VydmF0aW9uIHRoYXQgMm5kIGFuZCAzcmQgY2xhc3MgcGFzc2VuZ2VycyBoYXZlIGhpZ2hlciBmYXRhbGl0eSByYXRlcy4KCmBgYHtyLCBtZXNzYWdlPUZBTFNFLCB3YXJuaW5nPUZBTFNFfQpnZXRfbGVnZW5kPC1mdW5jdGlvbihteWdncGxvdCl7CiAgdG1wIDwtIGdncGxvdF9ndGFibGUoZ2dwbG90X2J1aWxkKG15Z2dwbG90KSkKICBsZWcgPC0gd2hpY2goc2FwcGx5KHRtcCRncm9icywgZnVuY3Rpb24oeCkgeCRuYW1lKSA9PSAiZ3VpZGUtYm94IikKICBsZWdlbmQgPC0gdG1wJGdyb2JzW1tsZWddXQogIHJldHVybihsZWdlbmQpCn0KcCA8LSBsYXBwbHkoWCA9IGMoJ1BjbGFzcycsJ1NleCcsJ1NpYlNwJywnUGFyY2gnLCdFbWJhcmtlZCcpLAogICAgICAgICAgICBGVU4gPSBmdW5jdGlvbih4KSBnZ3Bsb3QoZGF0YSA9IHRyYWluLnJhdykrCiAgICAgICAgICAgICAgICBhZXNfc3RyaW5nKHg9eCxmaWxsPSdTdXJ2aXZlZCcpKwogICAgICAgICAgICAgICAgZ2VvbV9iYXIocG9zaXRpb249ImRvZGdlIikrCiAgICAgICAgICAgICAgICB0aGVtZShsZWdlbmQucG9zaXRpb249Im5vbmUiKSkKbGVnZW5kIDwtIGdldF9sZWdlbmQoZ2dwbG90KGRhdGEgPSB0cmFpbi5yYXcsYWVzKHg9UGNsYXNzLGZpbGw9U3Vydml2ZWQpKStnZW9tX2JhcigpKQpncmlkLmFycmFuZ2UocFtbMV1dLHBbWzJdXSxwW1szXV0scFtbNF1dLHBbWzVdXSxsZWdlbmQsbGF5b3V0X21hdHJpeCA9CiAgICAgICAgICAgICAgICAgY2JpbmQoYygxLDIsMyksYyg0LDUsTkEpLGMoNiw2LDYpKSx3aWR0aHM9YygzLDMsMSkpCiMgcm91bmQocHJvcC50YWJsZSh0YWJsZSh0cmFpbi5yYXckRW1iYXJrZWQsdHJhaW4ucmF3JFBjbGFzcyksbWFyZ2luID0gMiksMikKYGBgCgojIyMgTXVsdGl2YXJpYXRlIEFuYWx5c2VzCgpHcm91cGVkIGJveHBsb3RzIGFyZSBhIGNvbW1vbiBtZXRob2Qgb2YgY29tcGFyaW5nIGRpc3RyaWJ1dGlvbnMgZ3JvdXBlZCBieSBjYXRlZ29yaWNhbCB2YXJpYWJsZXMuIEkgZmluZCBbYmVhbnBsb3RzXShodHRwczovL2NyYW4uci1wcm9qZWN0Lm9yZy93ZWIvcGFja2FnZXMvYmVhbnBsb3QvYmVhbnBsb3QucGRmKSB0byBiZSBleGNlbGxlbnQgY29tcGxlbWVudGFyeSBwbG90cyB0byBib3hwbG90cyAoYW5kIGluIHNvbWUgY2FzZXMsIGV2ZW4gYmV0dGVyKS4gVGhleSdyZSBhIGJpdCB0cmlja3kgdG8gcmVhZCBhdCBmaXJzdCAtIHNpbmNlIHRoZXkgYXJlIHNvIHVuZGVydXRpbGl6ZWQgLSBidXQganVzdCB0aHJvdWdoIG9uZSBwbG90LCBhIHdlYWx0aCBvZiBpbmZvcm1hdGlvbiBjYW4gYmUgZXh0cmFjdGVkLlteM10KCkhlcmUgaXMgYSBjb21wYXJpc29uIG9mIHRoZSBzYW1lIGluZm9ybWF0aW9uIGJldHdlZW4gYSBib3hwbG90IGFuZCBhIGJlYW5wbG90LiBXaGF0IGNhbiB3ZSBpbmZlciBmcm9tIHRoZSBiZWFuIHBsb3QgYmV0dGVyPwoKMS4gVGhlIGJlYW5wbG90IGFsbG93cyB1cyB0byB2aXN1YWxpemUgdGhlIGRlbnNpdHkgZnVuY3Rpb24gb2YgdGhlIHBhcmFtZXRlciwgaW4gdGhpcyBjYXNlOiBBZ2UuIEZ1cnRoZXJtb3JlLCB0aGUgbGVuZ3RoIG9mIGVhY2ggYmVhbmxpbmUgaXMgY3VtdWxhdGl2ZSB0byB0aGUgbnVtYmVyIG9mIGRhdGFwb2ludHMgdGhhdCBleGlzdC4gUmlnaHRhd2F5LCB3ZSBjYW4gdGVsbCB0aGF0IFBjbGFzcz0zIGhhcyB0aGUgbW9zdCBkYXRhIGluIHRoZSBzZXQsIHdpdGggc3BhcnNlciBkYXRhIGF0IFBjbGFzcz0xLgoyLiBUaGUgbWVhbiB2YWx1ZXMgZm9yIDFzdCBjbGFzcyBpcyBoaWdoZXIgdGhhbiB0aGF0IGZvciAybmQgYW5kIDNyZCBjbGFzcy4gVGhlIGRpc3RyaWJ1dGlvbnMgb2YgZGVjZWFzZWQgYW5kIHN1cnZpdmVkIGZvciAxc3QgY2xhc3MgYXJlIGZhaXJseSBzaW1pbGFyLgozLiBGb3IgMm5kIGFuZCAzcmQgY2xhc3MsIHRoZSBzdXJ2aXZlZCBkYXRhIHNob3dzIGEgYmltb2RhbCBkaXN0cmlidXRpb24uIEJ1bXBzIGF0IHRoZSAwLTEwIGFnZSBzaG93IHRoYXQgY2hpbGRyZW4gd2VyZSBldmFjdWF0ZWQgZmlyc3QuIFRoaXMgaXMgYWxzbyB0aGUgcmVhc29uIHRoZSBtZWFuIHZhbHVlcyBmb3Igc3Vydml2ZWQgaXMgbG93ZXIuCjQuIEZvciAybmQgYW5kIDNyZCBjbGFzcywgdGhlIGRlY2Vhc2VkIGRhdGEgc2hvd3MgYSBmYWlybHkgbm9ybWFsIGRpc3RyaWJ1dGlvbi4KNS4gVGhlIGluZGl2aWR1YWwgbWVhc3VyZW1lbnRzIChyZXByZXNlbnRlZCBieSBibGFjayBsaW5lcykgcmVwcmVzZW50IGVhY2ggb2JzZXJ2YXRpb24gYW5kIGhlbHAgaWRlbnRpZnkgb3V0bGllcnMgbXVjaCBtb3JlIGVhc2lseSB0aGFuIGEgYm94cGxvdCBkb2VzLgoKW14zXTogUmVhZCBtb3JlIGFib3V0IGJlYW5wbG90cyBoZXJlOiBodHRwczovL2NyYW4uci1wcm9qZWN0Lm9yZy93ZWIvcGFja2FnZXMvYmVhbnBsb3QvdmlnbmV0dGVzL2JlYW5wbG90LnBkZgoKYGBge3IsIGZpZy5oZWlnaHQ9MywgZmlnLndpZHRoPTUsIG1lc3NhZ2U9RkFMU0UsIHdhcm5pbmc9RkFMU0V9CmdncGxvdCh0cmFpbi5yYXcsYWVzKHk9QWdlLHg9UGNsYXNzKSkrZ2VvbV9ib3hwbG90KGFlcyhmaWxsPVN1cnZpdmVkKSkrdGhlbWVfYncoKQpiZWFucGxvdChBZ2V+U3Vydml2ZWQqUGNsYXNzLHNpZGU9J2InLHRyYWluLnJhdyxjb2w9bGlzdCgneWVsbG93Jywnb3JhbmdlJyksCiAgICAgICAgIGJvcmRlciA9IGMoJ3llbGxvdzInLCdkYXJrb3JhbmdlJyksbGwgPSAwLjA1LGJveHdleCA9IC41LAogICAgICAgICBtYWluPSdQYXNzZW5nZXIgc3Vydml2YWwgYnkgcGNsYXNzIGFuZCBBZ2UnLHhsYWI9J1Bhc3NlbmdlciBDbGFzcycseWxhYj0nQWdlJykKbGVnZW5kKCd0b3ByaWdodCcsIGZpbGwgPSBjKCd5ZWxsb3cnLCdvcmFuZ2UnKSwgbGVnZW5kID0gYygiRGVhZCIsICJTdXJ2aXZlZCIpLGJ0eSA9ICduJyxjZXggPSAuOCkKYGBgCgpBIGxvb2sgaW50byB0aGUgYFNpYlNwYCBhbmQgYFBhcmNoYCB2YXJpYWJsZXMgc2hvd3Mgc29tZXRoaW5nIGludGVyZXN0aW5nLiBUaGVyZSBhcmUgdGhyZWUgcmVnaW9ucyBvbmUgY2FuIGlkZW50aWZ5OgoKKiBUaGUgcHJvYmFiaWxpdHkgb2Ygc3Vydml2YWwgaXMgbWluaW1hbCBmb3IgbnVtYmVyIG9mIHBhcmVudHMvY2hpbGRyZW4gYWJvYXJkID4gMy4KKiBUaGUgcHJvYmFiaWxpdHkgb2Ygc3Vydml2YWwgaXMgbWluaW1hbCBmb3IgbnVtYmVyIG9mIHNpYmxpbmdzL3Nwb3VzZXMgYWJvYXJkID4gMy4KKiBGb3IgYFNpYlNwYDw9MyBhbmQgYFBhcmNoYDw9MywgdGhlcmUgYXJlIGJldHRlciBjaGFuY2VzIGZvciBzdXJ2aXZhbC4KClRoZSBncm91cGluZyBieSBgUGNsYXNzYCByZXZlYWxzIHRoYXQgYWxsIHRoZSBsYXJnZSBmYW1pbGllcyB3ZXJlIDNyZCBjbGFzcyB0cmF2ZWxlcnMuIFdvcnNlIGFjY2VzcyB0byBoZWxwLi4uIGxvd2VzdCBjaGFuY2UgZm9yIHN1cnZpdmFsLgoKVGhlc2UgY291bGQgYmUgc2ltcGxlIHJ1bGVzIGVpdGhlciBoYXJkIGNvZGVkIGR1cmluZyBtb2RlbCBidWlsZGluZzogc29tZXRoaW5nIGFsb25nIHRoZSBsaW5lcyBvZjogKklGIChTaWJTcD4zIE9SIFBhcmNoID4zKSBUSEVOIHByZWRpY3Rpb24gPSAwKiwgb3Igc29tZSBkZXJpdmVkIHZhcmlhYmxlcyBjYW4gYmUgY3JlYXRlZC4KCmBgYHtyfQpnZ3Bsb3QodHJhaW4ucmF3LGFlcyh5PVNpYlNwLHg9UGFyY2gpKSsKICAgIGdlb21faml0dGVyKGFlcyhjb2xvcj1TdXJ2aXZlZCxzaGFwZT1QY2xhc3MpKSsKICAgIHRoZW1lX2J3KCkrCiAgICBzY2FsZV9zaGFwZShzb2xpZD1GKSsKICAgIGdlb21fdmxpbmUoeGludGVyY2VwdCA9IDMsY29sb3I9J2RhcmtibHVlJyxsdHk9MykrCiAgICBnZW9tX2hsaW5lKHlpbnRlcmNlcHQgPSAzLGNvbG9yPSdkYXJrYmx1ZScsbHR5PTMpCmBgYAoKKioqCgojIERhdGEgUHJlcGFyYXRpb24KIyMgTWlzc2luZyBWYWx1ZXMgSW1wdXRhdGlvbgpTdGFydGluZyB3aXRoIHRoZSBlYXNpZXIgb25lIGZpcnN0OgoKKipFbWJhcmtlZCoqOiBUaGUgbGFyZ2VzdCBwb3J0aW9uIG9mIHRoZSBwYXNzZW5nZXJzIGVtYmFyZWQgYXQgU291dGhoYW1wdG9uLiBJJ20gcmVwbGFjaW5nIHRoZSBOQXMgd2l0aCB0aGUgc2FtZS4gRmlyc3QsIEkgY3JlYXRlIGEgbmV3IGltcHV0ZWQgdHJhaW5pbmcgZGF0YXNldC4KCmBgYHtyfQpzdW1tYXJ5KHRyYWluLnJhdyRFbWJhcmtlZCkKdHJhaW4uaW1wIDwtIHRyYWluLnJhdwp0cmFpbi5pbXAkRW1iYXJrZWRbaXMubmEodHJhaW4uaW1wJEVtYmFya2VkKV0gPC0gJ1MnCmBgYAoKKipOYW1lcywgVGl0bGVzICYgQWdlKio6CgpUaGUgbmFtZXMgaGF2ZSB0aXRsZXMgZW1iZWRkZWQgaW4gdGhlIHN0cmluZ3MuIEkgY2FuIGV4dHJhY3QgdGhlc2UgdXNpbmcgcmVnZXguIE1hc3RlciwgTWlzcywgTXIgYW5kIE1ycyBhcmUgdGhlIG1vc3QgcG9wdWxhciAtIG5vIHN1cnByaXNlIHRoZXJlLCB3aXRoIGxvdHMgb2Ygb3RoZXIgdGl0bGVzLiAgSGVyZSdzIHRoZSBkaXN0cmlidXRpb24gb2YgdGhlIHRpdGxlcyBieSBhZ2UuIFRoZXNlIGNhbiBiZSB1c2VkIHRvIGltcHV0ZSB0aGUgbWlzc2luZyBhZ2UgdmFsdWVzLgoKYGBge3IsIG1lc3NhZ2U9RkFMU0UsIHdhcm5pbmc9RkFMU0V9CnRyYWluLmltcCR0aXRsZSA8LSBzdHJfZXh0cmFjdChwYXR0ZXJuID0gJ1thLXpBLVpdKyg/PVxcLiknLHN0cmluZyA9IHRyYWluLmltcCROYW1lKQp0cmFpbi5pbXAkdGl0bGUgPC0gYXMuZmFjdG9yKHRyYWluLmltcCR0aXRsZSkKCnRyYWluLmltcCAlPiUKICAgIG5hLm9taXQoKSAlPiUKICAgIGdyb3VwX2J5KHRpdGxlKSAlPiUKICAgIGRwbHlyOjpzdW1tYXJpc2UoQ291bnQ9bigpLCBNZWRpYW5fQWdlPXJvdW5kKG1lZGlhbihBZ2UpLDApKSAlPiUKICAgIGFycmFuZ2UoLU1lZGlhbl9BZ2UpCmBgYAoKYGBge3IsIG1lc3NhZ2U9RkFMU0UsIHdhcm5pbmc9RkFMU0V9CmdncGxvdCh0cmFpbi5pbXAsYWVzKHg9dGl0bGUseT1BZ2UpKSsKICAgIHN0YXRfc3VtbWFyeShhZXMoeSA9IEFnZSxncm91cD0xKSwgZnVuLnk9bWVkaWFuLCBjb2xvdXI9InJlZCIsIGdlb209InBvaW50Iixncm91cD0xKSsKICAgIGdlb21faml0dGVyKHNoYXBlPTIxLGFscGhhPS42LGNvbD0nYmx1ZScpKwogICAgdGhlbWVfYncoKSsKICAgIHRoZW1lKGF4aXMudGV4dC54ID0gZWxlbWVudF90ZXh0KGFuZ2xlID0gNDUsIGhqdXN0ID0gMSksbGVnZW5kLnBvc2l0aW9uPSJub25lIikrCiAgICBsYWJzKGNhcHRpb249J1JlZCBwb2ludHMgYXJlIG1lZGlhbiB2YWx1ZXMnKQpgYGAKCkdyb3VwaW5nIHNpbWlsYXIgdGl0bGVzIHRvZ2V0aGVyLCBJJ3ZlIGtlcHQgYSBmZXcgdGl0bGVzIC0gT2ZmaWNlciwgUm95YWx0eSwgTXIsIE1ycyBhbmQgTWlzcy4KCmBgYHtyfQp0cmFpbi5pbXAkdGl0bGUgPC0gYXMuY2hhcmFjdGVyKHRyYWluLmltcCR0aXRsZSkKdHJhaW4uaW1wJHRpdGxlW3RyYWluLmltcCR0aXRsZSAlaW4lIGMoJ0NvbCcsJ01ham9yJyldIDwtICdPZmZpY2VyJwp0cmFpbi5pbXAkdGl0bGVbdHJhaW4uaW1wJHRpdGxlICVpbiUgYygnRG9uJywnRHInLCdSZXYnLCdTaXInLCdKb25raGVlcicsJ0NvdW50ZXNzJywnTGFkeScsJ0RvbmEnKV0gPC0gJ1JveWFsdHknCnRyYWluLmltcCR0aXRsZVt0cmFpbi5pbXAkdGl0bGUgJWluJSBjKCdNcnMnLCdNbWUnKV0gPC0gJ01ycycKdHJhaW4uaW1wJHRpdGxlW3RyYWluLmltcCR0aXRsZSAlaW4lIGMoJ01zJywnTWxsZScpXSA8LSAnTWlzcycKdHJhaW4uaW1wJHRpdGxlIDwtIGFzLmZhY3Rvcih0cmFpbi5pbXAkdGl0bGUpCmBgYAoKYGBge3J9CmdncGxvdCh0cmFpbi5pbXAsYWVzKHg9dGl0bGUseT1BZ2UpKSsKICAgIGdlb21faml0dGVyKGNvbG9yPSdibHVlJyxzaGFwZT0yMSxhbHBoYT0uNykrCiAgICBzdGF0X3N1bW1hcnkoYWVzKHkgPSBBZ2UsZ3JvdXA9MSksIGZ1bi55PW1lZGlhbiwgY29sb3VyPSJyZWQiLCBnZW9tPSJwb2ludCIsZ3JvdXA9MSkrCiAgICB0aGVtZV9idygpKwogICAgdGhlbWUoYXhpcy50ZXh0LnggPSBlbGVtZW50X3RleHQoYW5nbGUgPSA0NSwgaGp1c3QgPSAxKSkrCiAgICBsYWJzKGNhcHRpb249J1JlZCBwb2ludHMgYXJlIG1lZGlhbiB2YWx1ZXMnKQpgYGAKCk5vdyBmb3IgdGhlIG1pc3NpbmcgQWdlIHZhbHVlcy4gSSdtIHRyeWluZyBvdXQgdHdvIHN0cmF0ZWdpZXMgdG8gaW1wdXRlIGFnZSwganVzdCBmb3Iga2lja3MuIEZpcnN0LCBhIHJlZ3Jlc3Npb24gdHJlZSB1c2luZyB0aGUgYHJwYXJ0YCBtZXRob2QuIDUtcmVwZWF0IDEwLWZvbGQgY3Jvc3MgdmFsaWRhdGlvbiBhY3Jvc3MgYSB0dW5pbmcgZ3JpZCBvZiAyMCB2YWx1ZXMgb2YgYG1heGRlcHRoYC4gUk1TRSBzdGFibGl6ZXMgYXQgYSBkZXB0aCBvZiAxNCwgd2l0aCBhIHZhbHVlIG9mIDEyLjIuCgpgYGB7cn0KYWdlLnByZWRpY3RvcnMgPC0gdHJhaW4uaW1wICU+JQogICAgZHBseXI6OnNlbGVjdCgtU3Vydml2ZWQsLUNhYmluLC1UaWNrZXQsLU5hbWUpICU+JQogICAgZmlsdGVyKGNvbXBsZXRlLmNhc2VzKC4pKQpzZXQuc2VlZCgxMjM0KQpjdHJsIDwtIHRyYWluQ29udHJvbChtZXRob2QgPSAiYm9vdCIsCiAgICAgICAgICAgICAgICAgICAgIHJlcGVhdHMgPSA1LAogICAgICAgICAgICAgICAgICAgICBudW1iZXIgPSAyMDAKICAgICAgICAgICAgICAgICAgICAgKQpycGFydEdyaWQgPC0gZGF0YS5mcmFtZShtYXhkZXB0aCA9IHNlcSg0LDIwLDIpKQpycGFydEZpdCA8LSB0cmFpbihBZ2V+LiwKICAgICAgICAgICAgICAgICAgZGF0YT1hZ2UucHJlZGljdG9ycywKICAgICAgICAgICAgICAgICAgbWV0aG9kPSdycGFydDInLAogICAgICAgICAgICAgICAgICB0ckNvbnRyb2wgPSBjdHJsLAogICAgICAgICAgICAgICAgICB0dW5lR3JpZCA9IHJwYXJ0R3JpZAogICAgICAgICAgICAgICAgICApCnJwYXJ0Rml0CnBsb3QocnBhcnRGaXQpCnBsb3QocnBhcnRGaXQkZmluYWxNb2RlbCxtYXJnaW49MC4wMikKdGV4dChycGFydEZpdCRmaW5hbE1vZGVsLGNleD0wLjgpCmBgYAoKQW5vdGhlciB3YXkgaXMgdG8gcnVuIGEgcmFuZG9tZm9yZXN0IHdpdGggYSBzZWFyY2ggb3ZlciB2YWx1ZXMgb2YgYG10cnlgIHVzaW5nIDUtcmVwZWF0IDEwLWZvbGQgY3Jvc3MgdmFsaWRhdGlvbi4gQXMgd2UgY2FuIHNlZSBtdHJ5PTQgaXMgdGhlIG9wdGltYWwgdmFsdWUgd2hpY2ggcmVzdWx0cyBpbiB0aGUgbG93ZXN0IFJNU0Ugb2YgMTEuNDsgbXVjaCBiZXR0ZXIgdGhhbiB0aGUgcnBhcnQgbW9kZWwuCgpgYGB7cn0Kc2V0LnNlZWQoMTIzNCkKcmZHcmlkIDwtIGRhdGEuZnJhbWUobXRyeT1zZXEoMSw2LDEpKQpjdHJsIDwtIHRyYWluQ29udHJvbChtZXRob2QgPSAicmVwZWF0ZWRjdiIsCiAgICAgICAgICAgICAgICAgICAgIHJlcGVhdHMgPSA1CiAgICAgICAgICAgICAgICAgICAgICkKcmZGaXQgPC0gdHJhaW4oQWdlfi4sCiAgICAgICAgICAgICAgICAgIGRhdGE9YWdlLnByZWRpY3RvcnMsCiAgICAgICAgICAgICAgICAgIG1ldGhvZD0ncmYnLAogICAgICAgICAgICAgICAgICB0ckNvbnRyb2wgPSBjdHJsLAogICAgICAgICAgICAgICAgICB0dW5lR3JpZCA9IHJmR3JpZCkKcmZGaXQKcGxvdChyZkZpdCkKYGBgCgpJJ20gZ29pbmcgdG8gdXNlIHRoZSByYW5kb21Gb3Jlc3QgbW9kZWwuIFVzaW5nIHRoZSBgcHJlZGljdC50cmFpbigpYCB0byBwcmVkaWN0IHZhbHVlcyBvZiBhZ2UgYW5kIHBsdWcgdGhlbSBiYWNrIGludG8gdGhlIGltcHV0ZWQgZGF0YS4gWW91IGNhbiBzZWUgdGhlIGJsdWUgcG9pbnRzIHdoaWNoIGFyZSB0aGUgaW1wdXRlZCB2YWx1ZXMgb2YgYEFnZWAuIFdoYXQgSSBub3RpY2VkIGlzIHRoYXQgZm9yIGFsbCB0aGUgdGl0bGVzLCB0aGUgaW1wdXRlZCBBZ2UgdmFsdWUgc2VlbXMgdG8gYmUgZGlzdHJpYnV0ZWQgZmFpcmx5IHdlbGwsIGV4Y2VwdCBNYXN0ZXIuIEZvciBNYXN0ZXIsIHRoZSB0aHJlZSBpbXB1dGVkIGFyZSBkZWZpbml0ZWx5IG91dGxpZXJzLiBJJ20gZ29pbmcgdG8gZm9yY2UgdGhlc2UgdG8gdGhlIG1lZGlhbiBBZ2UuCgpgYGB7cn0KbWlzc2luZy5hZ2UgPC0gdHJhaW4uaW1wICU+JSBmaWx0ZXIoaXMubmEoQWdlKSkKYWdlLnByZWRpY3RlZCA8LSBwcmVkaWN0KHJmRml0LCBuZXdkYXRhID0gbWlzc2luZy5hZ2UpCnRyYWluLmltcCAlPiUKICAgIG11dGF0ZShBZ2VNaXNzaW5nID0gaXMubmEoQWdlKSwKICAgICAgICAgICBBZ2UgPSBpZmVsc2UoQWdlTWlzc2luZyxhZ2UucHJlZGljdGVkLEFnZSkpICU+JQogICAgZ2dwbG90KGFlcyh4PXRpdGxlLHk9QWdlKSkrCiAgICBzdGF0X3N1bW1hcnkoYWVzKHkgPSBBZ2UsZ3JvdXA9MSksIGZ1bi55PW1lZGlhbiwgY29sb3VyPSJyZWQiLCBnZW9tPSJwb2ludCIsZ3JvdXA9MSkrCiAgICBnZW9tX2ppdHRlcihhZXMoeT1BZ2UsY29sPUFnZU1pc3NpbmcpLHNoYXBlPTIpKwogICAgdGhlbWVfYncoKSsKICAgIHRoZW1lKGF4aXMudGV4dC54ID0gZWxlbWVudF90ZXh0KGFuZ2xlID0gNDUsIGhqdXN0ID0gMSksbGVnZW5kLnBvc2l0aW9uPSJub25lIikrCiAgICBsYWJzKGNhcHRpb249J1JlZCBwb2ludHMgYXJlIG1lZGlhbiB2YWx1ZXMnKQp0cmFpbi5pbXAkQWdlW2lzLm5hKHRyYWluLmltcCRBZ2UpXSA8LSBhZ2UucHJlZGljdGVkCnRyYWluLmltcCRBZ2VbdHJhaW4uaW1wJHRpdGxlPT0nTWFzdGVyJyAmIHRyYWluLmltcCRBZ2UgPiAyMF0gPC0gbWVkaWFuKHRyYWluLmltcCRBZ2VbdHJhaW4uaW1wJHRpdGxlPT0nTWFzdGVyJ10sbmEucm0gPSBUKQpgYGAKCiMjIERlcml2ZWQgVmFyaWFibGVzCgoKKipDaGlsZD86KiogVHJ5aW5nIG91dCB0d28gZW5naW5lZXJlZCB2YXJpYWJsZXMgaGVyZSAtIGlzIHRoZSBwYXNzZW5nZXIgYSBjaGlsZCBvciBub3Q/IFVzaW5nIEFnZT0xOCBhcyBhIHRocmVzaG9sZC4gQW5kIGlzIHMvaGUgY2xvc2UgZW5vdWdoIHRvIGJlIGNvbnNpZGVyZWQgYSBhZHVsdCBieSBjaGFuY2U/IFRob3NlIGJldHdlZW4gMTYgYW5kIDE4IGNvdWxkIGJlIG1pc3Rha2VuIGZvciBub3QgYmVpbmcgY2hpbGRyZW4uIChNeSB3YXkgb2YgaW5jb3Jwb3JhdGluZyBhIGZ1ZGdlIGZhY3RvciBpbiB0aGUgZGVjaXNpb24gcHJvY2VzcyBvZiBsYWRpZXMgJiBjaGlsZHJlbiBmaXJzdC4pCgpgYGB7cn0KdHJhaW4uaW1wJGNoaWxkIDwtIDAKdHJhaW4uaW1wJGNoaWxkW3RyYWluLmltcCRBZ2U8MThdIDwtIDEKdHJhaW4uaW1wJGFsbW9zdGFkdWx0IDwtIGFzLm51bWVyaWMoYmV0d2Vlbih0cmFpbi5pbXAkQWdlLDE2LDE4KSkKYGBgCgoqKlJlYWxseSB5b3VuZywgb3IgcmVhbGx5IG9sZD86KiogUmVhbGx5IHlvdW5nIG9uZXMgYW5kIG9sZGVyIGZvbGtzIHdvdWxkIGdldCBwcmlvcml0eSBwZXJoYXBzLiBDcmVhdGluZyB0d28gY2F0ZWdvcmljYWwgYmluYXJ5IHZhcmlhYmxlcyBmb3IgdGhlc2UgY29uZGl0aW9ucy4KYGBge3J9CnRyYWluLmltcCRZb3VuZyA8LSBpZmVsc2UodHJhaW4uaW1wJEFnZTwxMCwxLDApCnRyYWluLmltcCRTZW5pb3JzIDwtIGlmZWxzZSh0cmFpbi5pbXAkQWdlPjYwLDEsMCkKYGBgCgoKKipGYW1pbHkgcmVsYXRlZDoqKiBMZXQncyBhbHNvIGNyZWF0ZSBzb21lIHZhcmlhYmxlcyB0aGF0IHRhbGsgYWJvdXQgZmFtaWx5IHNpemVzLiBXaGF0J3MgdGhlIHRvdGFsIGZhbWlseSBzaXplIC0tIGNvbnRpbm91cyB2YXJpYWJsZSBgVG90YWxGYW1gLiBJcyB0aGUgcGVyc29uIHNpbmdsZSwgcGFydCBvZiBhIGNvdXBsZSBvciBhIGxhcmdlIGZhbWlseT8gVGhyZWUgY2F0ZWdvcmljYWwgdmFyaWFibGVzIGZvciB0aGVzZS4KCmBgYHtyfQp0cmFpbi5pbXAkVG90YWxGYW0gPC0gdHJhaW4uaW1wJFNpYlNwICsgdHJhaW4uaW1wJFBhcmNoICsgMQp0cmFpbi5pbXAkTGFyZ2VQYXJDaCA8LSBhcy5udW1lcmljKHRyYWluLmltcCRQYXJjaD49MykKdHJhaW4uaW1wJExhcmdlU2liU3AgPC0gYXMubnVtZXJpYyh0cmFpbi5pbXAkU2liU3A+PTMpCnRyYWluLmltcCRTaW5nbGUgPC0gaWZlbHNlKHRyYWluLmltcCRUb3RhbEZhbT09MSwxLDApCnRyYWluLmltcCRDb3VwbGUgPC0gaWZlbHNlKHRyYWluLmltcCRUb3RhbEZhbT09MiwxLDApCnRyYWluLmltcCRGYW1pbHkgPC0gaWZlbHNlKHRyYWluLmltcCRUb3RhbEZhbT40LDEsMCkKdHJhaW4uaW1wJE5hbWUgPC0gTlVMTApgYGAKCioqQ2FiaW4gcmVsYXRlZDoqKiBFeHRyYWN0aW5nIHRoZSBjYWJpbiBhbHBoYWJldCBhbmQgbnVtYmVyIGZyb20gdGhlIGNhYmluIHZhcmlhYmxlLiBTaW5jZSB0aGUgY2FiaW4gbnVtYmVycyBjb3VsZCBiZSBvcmRlcmVkIGZyb20gbGVmdCB0byByaWdodCBvciB0b3AgdG8gYm90dG9tIG9uIHRoZSBib2F0LCBwZXJoYXBzIG9ubHkgdGhlIDFzdCBkaWdpdCBpcyBzaWduaWZpY2FudC4gQWxzbywgc29tZSBmb2xrcyBoYXZlIG1vcmUgdGhhbiAxIGNhYmluLiBXb25kZXIgaWYgdGhhdCdzIGltcG9ydGFudC4gU2luY2UgbG90cyBvZiB1bmtub3ducyBpbiB0aGUgYENhYmluYCB2YXJpYWJsZSwgYWxsIE5BIHZhbHVlcyBhcmUgcmVwbGFjZWQgYnkgJ1UnLiBSZWZlcmluZyB0byB0aGUgZGVjayBkaWFncmFtLCB0aGUgdG9wbW9zdCBkZWNrcyBhcmUgQSBhbmQgQiwgd2hpY2ggYXJlIGNsb3Nlc3QgdG8gdGhlIGxpZmVib2F0cy4gUGVyaGFwcyB0aGF0J3MgaW1wb3J0YW50IHRvby4gSGVyZSwgSSBjcmVhdGUgYSBidW5jaCBvZiBjYXRlZ29yaWNhbCB2YXJpYWJsZXMgYmFzZWQgb2ZmIHRoZSBvcmlnaW5hbCBgQ2FiaW5gLCBhbmQgdGhlbiByZW1vdmUgaXQgZnJvbSB0aGUgZGF0YXNldC4KCmBgYHtyfQp0cmFpbi5pbXAkQ2FiaW5NaXNzaW5nIDwtIGFzLm51bWVyaWMoaXMubmEodHJhaW4ucmF3JENhYmluKSkKCnRyYWluLmltcCRDYWJpbkNvZGUgPC0gbWFwX2Nocih0cmFpbi5yYXckQ2FiaW4sfnN0cl9zcGxpdChzdHJpbmcgPSAueCxwYXR0ZXJuID0gJycpW1sxXV1bMV0pCnRyYWluLmltcCRDYWJpbkNvZGVbaXMubmEodHJhaW4uaW1wJENhYmluQ29kZSldIDwtICdVJwoKdHJhaW4uaW1wJENhYmluTnVtIDwtIGFzLm51bWVyaWMobWFwX2Nocih0cmFpbi5yYXckQ2FiaW4sfnN0cl9zcGxpdChzdHJpbmcgPSAueCxwYXR0ZXJuID0gJ1thLXpBLVpdJylbWzFdXVsyXSkpCnRyYWluLmltcCRDYWJpbk51bSA8LSBtYXBfaW50KHRyYWluLmltcCRDYWJpbk51bSwgfmFzLmludGVnZXIoc3RyX3NwbGl0KC54LHBhdHRlcm4gPSAnJyxzaW1wbGlmeSA9IFQpWzFdWzFdKSkKdHJhaW4uaW1wJENhYmluTnVtW2lzLm5hKHRyYWluLmltcCRDYWJpbk51bSldIDwtIDAKCnRyYWluLmltcCRUb3BEZWNrIDwtIGlmZWxzZSh0cmFpbi5pbXAkQ2FiaW5Db2RlICVpbiUgYygnQScsJ0InKSwxLDApCnRyYWluLmltcCRNaWREZWNrIDwtIGlmZWxzZSh0cmFpbi5pbXAkQ2FiaW5Db2RlICVpbiUgYygnQycsJ0QnKSwxLDApCnRyYWluLmltcCRMb3dlckRlY2sgPC0gaWZlbHNlKHRyYWluLmltcCRUb3BEZWNrPT0wICYgdHJhaW4uaW1wJE1pZERlY2sgPT0wICwxLDApCgp0cmFpbi5pbXAkTnVtYmVyb2ZDYWJpbnMgPC0gbWFwX2ludCh0cmFpbi5yYXckQ2FiaW4sfnN0cl9zcGxpdChzdHJpbmcgPSAueCxwYXR0ZXJuID0gJyAnKVtbMV1dICU+JSBsZW5ndGgpCnRyYWluLmltcCRDYWJpbiA8LSBOVUxMCmBgYAoKKipUaWNrZXQ6KiogTGFzdGx5LCB0aGUgYHRpY2tldGAgdmFyaWFibGUuIEknbSBub3Qgc3VyZSB3aGF0IHRvIG1ha2Ugb2YgaXQsIHNvIEknbSBrZWVwaW5nIGl0IGZvciBub3csIGFmdGVyIGNsZWFuaW5nIGl0IHVwIGEgYml0LiBBIG1ham9yaXR5ICg4MCUpIG9mIHRoZSByb3dzIGhhdmUgdW5pcXVlIChvbmUpIHRpY2tldC4gMTQlIHJvd3MgaGF2ZSBhIGR1cGxpY2F0ZSB0aWNrZXQsIHBlcmhhcHMgaW5kaWNhdGluZyBhIGZhbWlseS4gQSBzbWFsbCBudW1iZXIgb2Ygcm93cyBoYXZlIDMrIGR1cGxpY2F0ZXMgb2YgdGhlIHRpY2tldHMuCgpgYGB7cn0KdHJhaW4uaW1wJFRpY2tldCAlPiUgdGFibGUoKSAlPiUgYXMubnVtZXJpYygpICU+JSB0YWJsZSgpCmBgYAoKVGhlcmUgc2VlbXMgdG8gYmUgYSBiaXQgb2YgYSBwYXR0ZXJuIGhlcmUuIFRpY2tldHMgc3RhcnRpbmcgd2l0aCAxIGFyZSBtb3N0bHkgMXN0IGNsYXNzLCB0aG9zZSBzdGFydGluZyB3aXRoIDIgYXJlIDJuZCBjbGFzcywgYW5kIDMgLSAzcmQgY2xhc3MuIEJ1dCwgSSBmZWVsIGl0J3MgYSB2ZXJ5IGxvb3NlIGFzc29jaWF0aW9uLgpgYGB7cn0KdHJhaW4uaW1wICU+JSBncm91cF9ieShQY2xhc3MpICU+JSBkcGx5cjo6c2VsZWN0KFRpY2tldCxQY2xhc3MpICU+JSBzYW1wbGVfbig1KQpgYGAKCldoYXQgSSdtIGdvaW5nIHRvIGRvIGlzIGNsZWFuIHVwIHRoZSBjb2x1bW5zIChyZW1vdmUgc3BlY2lhbCBjaGFyYWN0ZXJzLCBzcGFjZXMgZXRjKSwgdGhlbiBzcGxpdCB0aGUgYFRpY2tldGAgY29sdW1uIGludG8gZm91cjogYFRpY2tldENoYXJgLCBgVGlja2V0TnVtYCxgVGlja2V0TnVtTGVuZ3RoYCwgYFRpY2tldE51bVN0YXJ0YC4gIChVcG9uIHJ1bm5pbmcgdGhlIHNjcmlwdCBhIGZldyB0aW1lcywgSSd2ZSBkZWNpZGVkIHRvIGdldCByaWQgb2YgYFRpY2tldE51bWAsIGJ1dCBJJ20gY29tbWVudGluZyB0aGUgY29kZSBmb3IgZnV0dXJlIHJlZikuIFRoZSBgVGlja2V0Q2hhcmAgdmFyaWFibGUgYXMgdGhpcyBkaXN0cmlidXRpb246CgpgYGB7cn0KdHJhaW4uaW1wICU8PiUKICAgIG11dGF0ZSgKICAgICAgICBUaWNrZXQgPSBzdHJfdG9fdXBwZXIoVGlja2V0KSAlPiUKICAgICAgICAgICAgc3RyX3JlcGxhY2VfYWxsKHBhdHRlcm4gPSByZWdleChwYXR0ZXJuID0gJ1suXFwvXScpLHJlcGxhY2VtZW50ID0gJycpLAogICAgICAgIFRpY2tldE51bSA9IHN0cl9leHRyYWN0KFRpY2tldCxwYXR0ZXJuID0gcmVnZXgoJyhbMC05XSl7Myx9JykpLAogICAgICAgIFRpY2tldE51bVN0YXJ0ID0gbWFwX2ludChUaWNrZXROdW0sfmFzLmludGVnZXIoc3RyX3NwbGl0KC54LHBhdHRlcm4gPSAnJyxzaW1wbGlmeSA9IFQpWzFdKSksCiAgICAgICAgVGlja2V0TnVtTGVuID0gbWFwX2ludChUaWNrZXROdW0sfmRpbShzdHJfc3BsaXQoLngscGF0dGVybiA9ICcnLHNpbXBsaWZ5ID0gVCkpWzJdKSwKICAgICAgICBUaWNrZXRDaGFyID0gc3RyX2V4dHJhY3QoVGlja2V0LHBhdHRlcm4gPSByZWdleCgnXlthLXpBLVovXFwuXSsnKSkgCiAgICAgICAgKSAlPiUKICAgICBtdXRhdGUoCiAgICAgICAgIFRpY2tldENoYXIgPSBtYXBfY2hyKC54PVRpY2tldENoYXIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIC5mPX5zdHJfc3BsaXQoc3RyaW5nPS54LCBwYXR0ZXJuID0gJycsc2ltcGxpZnkgPSBUKVsxXSkKICAgICAgICAgKSAlPiUgICAgIAogICAgbXV0YXRlKAogICAgICAgIFRpY2tldENoYXIgPSBpZmVsc2UoaXMubmEoVGlja2V0Q2hhciksJ1UnLFRpY2tldENoYXIpLAogICAgICAgIFRpY2tldE51bVN0YXJ0ID0gaWZlbHNlKGlzLm5hKFRpY2tldE51bVN0YXJ0KSwwLFRpY2tldE51bVN0YXJ0KSwKICAgICAgICBUaWNrZXROdW1MZW4gPSBpZmVsc2UoaXMubmEoVGlja2V0TnVtTGVuKSwwLFRpY2tldE51bUxlbiksCiAgICApCnRyYWluLmltcCRUaWNrZXQgPC0gTlVMTAp0cmFpbi5pbXAkVGlja2V0TnVtIDwtIE5VTEwKdGFibGUodHJhaW4uaW1wJFRpY2tldENoYXIsZG5uID0nVGlja2V0Q2hhcicpCnRhYmxlKHRyYWluLmltcCRUaWNrZXROdW1MZW4sZG5uPSdUaWNrZXROdW1MZW4nKQp0YWJsZSh0cmFpbi5pbXAkVGlja2V0TnVtU3RhcnQsZG5uPSdUaWNrZXROdW1TdGFydCcpCmBgYAoKIyMgV2luem9yaW5nIFZhcmlhYmxlcwoKVGhlIGBmYXJlYCB2YXJpYWJsZSBoYXMgb25lIG1hc3NpdmUgb3V0bGllci4gV2luem9yaXNpbmcgdGhpcyB2YXJpYWJsZSB1c2luZyB0aGUgOTV0aCBwZXJjZW50aWxlIHZhbHVlIGFzIHRoZSBjdXRvZmYuCgpgYGB7cn0KIyBnZ3Bsb3QodHJhaW4uaW1wLGFlcyh4PUZhcmUsZmlsbD1QY2xhc3MpKStnZW9tX2hpc3RvZ3JhbSgpK2ZhY2V0X2dyaWQoUGNsYXNzfi4pCiMgcXVhbnRpbGUodHJhaW4uaW1wJEZhcmVbdHJhaW4uaW1wJFBjbGFzcz09J1AxJ10scHJvYnMgPSBjKC4xLC4yNSwuNSwuNzUsLjk1KSkKIyB0cmFpbi5pbXAkRmFyZVt0cmFpbi5pbXAkRmFyZT4yMzJdIDwtIDIzMgpgYGAKCiMjIEZpbmFsIERhdGEgUmV2aWV3CgpUaGUgZGF0YXNldCBpcyBub3cgcHJlcGFyZWQgZm9yIG1vZGVsaW5nLiBIZXJlJ3MgYSBxdWljayByZXZpZXcgb2YgdGhlIGRhdGEgc28gZmFyLiAyOSB2YXJpYWJsZXMgaW4gdG90YWwuCgpgYGB7cn0KdHJhaW4uaW1wICU+JSBnbGltcHNlKCkKYGBgCgoKKioqCgojIE1vZGVsaW5nCgpJJ20gZXhwZXJpbWVudGluZyB3aXRoIGEgZmV3IG1vZGVsaW5nIHRlY2huaXF1ZXMsIG1haW5seSBbeGdib29zdF0oaHR0cDovL3hnYm9vc3QucmVhZHRoZWRvY3MuaW8vZW4vbGF0ZXN0LyksIFtnYm1dKGh0dHBzOi8vY3Jhbi5yLXByb2plY3Qub3JnL3dlYi9wYWNrYWdlcy9nYm0vaW5kZXguaHRtbCksIGFuZCBwZW5hbGl6ZWQgbW9kZWxzIHVzaW5nIFtnbG1uZXRdKGh0dHBzOi8vY3Jhbi5yLXByb2plY3Qub3JnL3dlYi9wYWNrYWdlcy9nbG1uZXQvaW5kZXguaHRtbCkuIEkndmUgaW1wbGVtZW50ZWQgYWxsIHRoZXNlIG1vZGVscyB1c2luZyBbY2FyZXRdKGh0dHA6Ly90b3BlcG8uZ2l0aHViLmlvL2NhcmV0L2luZGV4Lmh0bWwpIHdoaWNoIEkgZmluZCBhbiBhYnNvbHV0ZWx5IGluZGlzcGVuc2libGUgdG9vbGtpdCB0byBwcmVwLCBidWlsZCwgdHVuZSBhbmQgZXhwbG9yZSBudW1lcm91cyBtb2RlbHMgdXNpbmcgdmVyeSBmZXcgbGluZXMgb2YgY29kZS4KCkZvciBhbGwgbW9kZWxzLCBJJ20gdXNpbmcgYSA1LXJlcGVhdCAxMC1mb2xkIGNyb3NzIHZhbGlkYXRpb24gdGVjaG5pcXVlIG9uIHRoZSB0cmFpbmluZyBkYXRhc2V0LiBUaHVzLCBJIGhhdmUgbm90IHNwbGl0IHRoZSB0cmFpbmluZyBkYXRhc2V0IGZ1cnRoZXIgaW50byB0ZXN0LXRyYWluIHNldHMsIGdpdmVuIHRoZSBzbWFsbCBudW1iZXIgb2Ygb2JzZXJ2YXRpb25zIGluIHRoZSBkYXRhc2V0LiAKCkZ1cnRoZXJtb3JlLCBnaXZlbiB0aGUgODA6MjAgY2xhc3MtaW1iYWxhbmNlLCBJJ20gYWxzbyB0cnlpbmcgb3V0IFtzbW90ZV0oaHR0cHM6Ly93d3cuamFpci5vcmcvbWVkaWEvOTUzL2xpdmUtOTUzLTIwMzctamFpci5wZGYpIGFzIGFuIGNsYXNzIGJhbGFuY2luZyB0ZWNobmlxdWUgZm9yIGEgZmV3IG1vZGVscy4gCgpUdW5pbmcgcGFyYW1ldGVyIHNlYXJjaGVzIChha2EgaHlwZXJ0dW5pbmcpIGlzIHBlcmZvcm1lZCB1c2luZyB0aGUgYHR1bmVHcmlkYCBwYXJhbWV0ZXIgaW4gdGhlIGB0cmFpbigpYCBjYWxsLiBUaGUgYmVzdCBtb2RlbCBpcyBzZWxlY3RlZCB1c2luZyB0aGUgQVVDIG9mIHRoZSBST0MuIEhlcmUgYXJlIHRoZSBtb2RlbHMgYW5kIGEgZmV3IGludGVybWVkaWF0ZSByZXN1bHRzIGZvciBlYWNoIG1vZGVsLiBBdCB0aGUgZW5kLCBJJ3ZlIGNvbXBhcmVkIHRoZSBwZXJmb3JtYW5jZSBvZiBhbGwgdGhlIG1vZGVscyB0b2dldGhlci4KCiMjIEV4dHJlbWUgR3JhZGllbnQgQm9vc3RpbmcgKHhnYm9vc3QgLSA1cmVwZWF0LTEwZm9sZC1jdiAtIHNtYWxsZXIgZGF0YXNldCkKYGBge3IsIGVjaG89VFJVRX0KY3RybCA8LSB0cmFpbkNvbnRyb2wobWV0aG9kID0gInJlcGVhdGVkY3YiLAogICAgICAgICAgICAgICAgICAgICByZXBlYXRzID0gNSwKICAgICAgICAgICAgICAgICAgICAgdmVyYm9zZUl0ZXIgPSBULAogICAgICAgICAgICAgICAgICAgICBjbGFzc1Byb2JzID0gVFJVRSwKICAgICAgICAgICAgICAgICAgICAgc3VtbWFyeUZ1bmN0aW9uID0gdHdvQ2xhc3NTdW1tYXJ5CiAgICAgICAgICAgICAgICAgICAgICMgc2FtcGxpbmcgPSAnc21vdGUnCiAgICAgICAgICAgICAgICAgICAgICkKc2V0LnNlZWQoMSkKeGdiR3JpZCA8LSBleHBhbmQuZ3JpZCgKICAgIG5yb3VuZHM9YygyLDMsNCw1LDYsNyksCiAgICBtYXhfZGVwdGg9YygyLDMsNCw1LDYsNyksCiAgICBldGE9YygwLjMsMC41KSwKICAgIGdhbW1hPTEsCiAgICBjb2xzYW1wbGVfYnl0cmVlPTEsCiAgICBtaW5fY2hpbGRfd2VpZ2h0PTEsCiAgICBzdWJzYW1wbGU9MQopCmRmLnNtYWxsZXIgPC0gdHJhaW4uaW1wICU+JSBkcGx5cjo6c2VsZWN0KAogICAgLWFsbW9zdGFkdWx0LCAtTGFyZ2VQYXJDaCwgLSBMYXJnZVNpYlNwLC1DYWJpbk1pc3NpbmcsLVRvcERlY2ssLU1pZERlY2ssLUxvd2VyRGVjaywtTnVtYmVyb2ZDYWJpbnMKKQpkdW1WIDwtIGR1bW15VmFycyhmb3JtdWxhID0gU3Vydml2ZWR+LixkYXRhID0gZGYuc21hbGxlcikKRHRyYWluIDwtIHByZWRpY3QoZHVtVixkZi5zbWFsbGVyKQp4Z2JzbWFsbEZpdCA8LSB0cmFpbigKICAgIHg9RHRyYWluLAogICAgeT10cmFpbi5pbXAkU3Vydml2ZWQsCiAgICBtZXRob2QgPSAneGdiVHJlZScsCiAgICB0ckNvbnRyb2wgPSBjdHJsLAogICAgIyBtZXRyaWMgPSAiS2FwcGEiLAogICAgdHVuZUdyaWQgPSB4Z2JHcmlkLAogICAgdmVyYm9zZSA9IFRSVUUKKQp4Z2JzbWFsbEZpdApwbG90KHhnYnNtYWxsRml0KQp4Z2IuaW1wb3J0YW5jZShmZWF0dXJlX25hbWVzID0gY29sbmFtZXMoRHRyYWluKSxtb2RlbCA9IHhnYnNtYWxsRml0JGZpbmFsTW9kZWwpICU+JQogICAgeGdiLmdncGxvdC5pbXBvcnRhbmNlKCkKCmRlbnNpdHlwbG90KHhnYnNtYWxsRml0LHBjaD0nfCcpCnByZWRpY3QoeGdic21hbGxGaXQsdHlwZSA9ICdwcm9iJykgLT4gdHJhaW4uUHJvYnMKaGlzdG9ncmFtKH5TdXJ2aXZlZCtEZWFkLHRyYWluLlByb2JzKQpgYGAKCiMjIEV4dHJlbWUgR3JhZGllbnQgQm9vc3RpbmcgKHhnYm9vc3QgLSA1cmVwZWF0LTEwZm9sZC1jdikKYGBge3IsIGVjaG89VFJVRX0KY3RybCA8LSB0cmFpbkNvbnRyb2wobWV0aG9kID0gInJlcGVhdGVkY3YiLAogICAgICAgICAgICAgICAgICAgICByZXBlYXRzID0gNSwKICAgICAgICAgICAgICAgICAgICAgdmVyYm9zZUl0ZXIgPSBULAogICAgICAgICAgICAgICAgICAgICBjbGFzc1Byb2JzID0gVFJVRSwKICAgICAgICAgICAgICAgICAgICAgc3VtbWFyeUZ1bmN0aW9uID0gdHdvQ2xhc3NTdW1tYXJ5CiAgICAgICAgICAgICAgICAgICAgICMgc2FtcGxpbmcgPSAnc21vdGUnCiAgICAgICAgICAgICAgICAgICAgICkKc2V0LnNlZWQoMSkKeGdiR3JpZCA8LSBleHBhbmQuZ3JpZCgKICAgIG5yb3VuZHM9YygyLDMsNCw1LDYsNyksCiAgICBtYXhfZGVwdGg9YygyLDMsNCw1LDYsNyksCiAgICBldGE9YygwLjMsMC41KSwKICAgIGdhbW1hPTEsCiAgICBjb2xzYW1wbGVfYnl0cmVlPTEsCiAgICBtaW5fY2hpbGRfd2VpZ2h0PTEsCiAgICBzdWJzYW1wbGU9MQopCmR1bVYgPC0gZHVtbXlWYXJzKGZvcm11bGEgPSBTdXJ2aXZlZH4uLGRhdGEgPSB0cmFpbi5pbXApCkR0cmFpbiA8LSBwcmVkaWN0KGR1bVYsdHJhaW4uaW1wKQp4Z2JGaXQgPC0gdHJhaW4oCiAgICB4PUR0cmFpbiwKICAgIHk9dHJhaW4uaW1wJFN1cnZpdmVkLAogICAgbWV0aG9kID0gJ3hnYlRyZWUnLAogICAgdHJDb250cm9sID0gY3RybCwKICAgICMgbWV0cmljID0gIkthcHBhIiwKICAgIHR1bmVHcmlkID0geGdiR3JpZCwKICAgIHZlcmJvc2UgPSBUUlVFCikKeGdiRml0CnBsb3QoeGdiRml0KQp4Z2IuaW1wb3J0YW5jZShmZWF0dXJlX25hbWVzID0gY29sbmFtZXMoRHRyYWluKSxtb2RlbCA9IHhnYkZpdCRmaW5hbE1vZGVsKSAlPiUKICAgIHhnYi5nZ3Bsb3QuaW1wb3J0YW5jZSgpCgpkZW5zaXR5cGxvdCh4Z2JGaXQscGNoPSd8JykKcHJlZGljdCh4Z2JGaXQsdHlwZSA9ICdwcm9iJykgLT4gdHJhaW4uUHJvYnMKaGlzdG9ncmFtKH5TdXJ2aXZlZCtEZWFkLHRyYWluLlByb2JzKQpgYGAKCiMjIEV4dHJlbWUgR3JhZGllbnQgQm9vc3RpbmcgKHhnYm9vc3QgLSA1dGVzdC10cmFpbiBzcGxpdCkKYGBge3IsIGVjaG89VFJVRX0KY3RybCA8LSB0cmFpbkNvbnRyb2wobWV0aG9kID0gJ0xHT0NWJywKICAgICAgICAgICAgICAgICAgICAgbnVtYmVyID0gNTAsCiAgICAgICAgICAgICAgICAgICAgIHZlcmJvc2VJdGVyID0gVCwKICAgICAgICAgICAgICAgICAgICAgY2xhc3NQcm9icyA9IFRSVUUsCiAgICAgICAgICAgICAgICAgICAgIHN1bW1hcnlGdW5jdGlvbiA9IHR3b0NsYXNzU3VtbWFyeQogICAgICAgICAgICAgICAgICAgICAjIHNhbXBsaW5nID0gJ3Ntb3RlJwogICAgICAgICAgICAgICAgICAgICApCnNldC5zZWVkKDEpCnhnYkdyaWQgPC0gZXhwYW5kLmdyaWQoCiAgICBucm91bmRzPWMoMiwzLDQsNSw2LDcpLAogICAgbWF4X2RlcHRoPWMoMiwzLDQsNSw2LDcpLAogICAgZXRhPWMoMC4zLDAuNSksCiAgICBnYW1tYT0xLAogICAgY29sc2FtcGxlX2J5dHJlZT0xLAogICAgbWluX2NoaWxkX3dlaWdodD0xLAogICAgc3Vic2FtcGxlPTEKKQpkdW1WIDwtIGR1bW15VmFycyhmb3JtdWxhID0gU3Vydml2ZWR+LixkYXRhID0gdHJhaW4uaW1wKQpEdHJhaW4gPC0gcHJlZGljdChkdW1WLHRyYWluLmltcCkKeGdiRml0LkxHT0NWIDwtIHRyYWluKAogICAgeD1EdHJhaW4sCiAgICB5PXRyYWluLmltcCRTdXJ2aXZlZCwKICAgIG1ldGhvZCA9ICd4Z2JUcmVlJywKICAgIHRyQ29udHJvbCA9IGN0cmwsCiAgICAjIG1ldHJpYyA9ICJLYXBwYSIsCiAgICB0dW5lR3JpZCA9IHhnYkdyaWQsCiAgICB2ZXJib3NlID0gVFJVRQopCnhnYkZpdC5MR09DVgpwbG90KHhnYkZpdC5MR09DVikKeGdiLmltcG9ydGFuY2UoZmVhdHVyZV9uYW1lcyA9IGNvbG5hbWVzKER0cmFpbiksbW9kZWwgPSB4Z2JGaXQuTEdPQ1YkZmluYWxNb2RlbCkgJT4lCiAgICB4Z2IuZ2dwbG90LmltcG9ydGFuY2UoKQoKZGVuc2l0eXBsb3QoeGdiRml0LkxHT0NWLHBjaD0nfCcpCnByZWRpY3QoeGdiRml0LkxHT0NWLHR5cGUgPSAncHJvYicpIC0+IHRyYWluLlByb2JzCmhpc3RvZ3JhbSh+U3Vydml2ZWQrRGVhZCx0cmFpbi5Qcm9icykKYGBgCgojIyBFeHRyZW1lIEdyYWRpZW50IEJvb3N0aW5nICh4Z2Jvb3N0KSAtIFNNT1RFIFNhbXBsaW5nCmBgYHtyfQpjdHJsIDwtIHRyYWluQ29udHJvbChtZXRob2QgPSAicmVwZWF0ZWRjdiIsCiAgICAgICAgICAgICAgICAgICAgIHJlcGVhdHMgPSA1LAogICAgICAgICAgICAgICAgICAgICB2ZXJib3NlSXRlciA9IFQsCiAgICAgICAgICAgICAgICAgICAgIGNsYXNzUHJvYnMgPSBUUlVFLAogICAgICAgICAgICAgICAgICAgICBzdW1tYXJ5RnVuY3Rpb24gPSB0d29DbGFzc1N1bW1hcnksCiAgICAgICAgICAgICAgICAgICAgIHNhbXBsaW5nID0gJ3Ntb3RlJwogICAgICAgICAgICAgICAgICAgICApCnhnYkdyaWQgPC0gZXhwYW5kLmdyaWQoCiAgICBucm91bmRzPWMoMiwzLDQsNSw2LDcpLAogICAgbWF4X2RlcHRoPWMoMiwzLDQsNSw2LDcpLAogICAgZXRhPWMoMC4zLDAuNSksCiAgICBnYW1tYT0xLAogICAgY29sc2FtcGxlX2J5dHJlZT0xLAogICAgbWluX2NoaWxkX3dlaWdodD0xLAogICAgc3Vic2FtcGxlPTEKKQpkdW1WIDwtIGR1bW15VmFycyhmb3JtdWxhID0gU3Vydml2ZWR+LixkYXRhID0gdHJhaW4uaW1wKQpEdHJhaW4gPC0gcHJlZGljdChkdW1WLHRyYWluLmltcCkKc2V0LnNlZWQoMSkKeGdic21vdGVGaXQgPC0gdHJhaW4oCiAgICB4PUR0cmFpbiwKICAgIHk9dHJhaW4uaW1wJFN1cnZpdmVkLAogICAgbWV0aG9kID0gJ3hnYlRyZWUnLAogICAgdHJDb250cm9sID0gY3RybCwKICAgICMgbWV0cmljID0gIkthcHBhIiwKICAgIHR1bmVHcmlkID0geGdiR3JpZCwKICAgIHZlcmJvc2UgPSBUUlVFCikKeGdic21vdGVGaXQKcGxvdCh4Z2JzbW90ZUZpdCkKeGdiLmltcG9ydGFuY2UoZmVhdHVyZV9uYW1lcyA9IGNvbG5hbWVzKER0cmFpbiksbW9kZWwgPSB4Z2JzbW90ZUZpdCRmaW5hbE1vZGVsKQp4Z2IuaW1wb3J0YW5jZShmZWF0dXJlX25hbWVzID0gY29sbmFtZXMoRHRyYWluKSxtb2RlbCA9IHhnYnNtb3RlRml0JGZpbmFsTW9kZWwpICU+JQp4Z2IuZ2dwbG90LmltcG9ydGFuY2UoKQoKZGVuc2l0eXBsb3QoeGdic21vdGVGaXQscGNoPSd8JykKcHJlZGljdCh4Z2JzbW90ZUZpdCx0eXBlID0gJ3JhdycpIC0+IHRyYWluLkNsYXNzCnByZWRpY3QoeGdic21vdGVGaXQsdHlwZSA9ICdwcm9iJykgLT4gdHJhaW4uUHJvYnMKaGlzdG9ncmFtKH5TdXJ2aXZlZCtEZWFkLHRyYWluLlByb2JzKQpgYGAKCiMjIEV4dHJlbWUgR3JhZGllbnQgQm9vc3RpbmcgKHhnYm9vc3QpIC0gZG93biBTYW1wbGluZwpgYGB7cn0KY3RybCA8LSB0cmFpbkNvbnRyb2wobWV0aG9kID0gInJlcGVhdGVkY3YiLAogICAgICAgICAgICAgICAgICAgICByZXBlYXRzID0gNSwKICAgICAgICAgICAgICAgICAgICAgdmVyYm9zZUl0ZXIgPSBULAogICAgICAgICAgICAgICAgICAgICBjbGFzc1Byb2JzID0gVFJVRSwKICAgICAgICAgICAgICAgICAgICAgc3VtbWFyeUZ1bmN0aW9uID0gdHdvQ2xhc3NTdW1tYXJ5LAogICAgICAgICAgICAgICAgICAgICBzYW1wbGluZyA9ICdkb3duJwogICAgICAgICAgICAgICAgICAgICApCnhnYkdyaWQgPC0gZXhwYW5kLmdyaWQoCiAgICBucm91bmRzPWMoMiwzLDQsNSw2LDcpLAogICAgbWF4X2RlcHRoPWMoMiwzLDQsNSw2LDcpLAogICAgZXRhPWMoMC4zLDAuNSksCiAgICBnYW1tYT0xLAogICAgY29sc2FtcGxlX2J5dHJlZT0xLAogICAgbWluX2NoaWxkX3dlaWdodD0xLAogICAgc3Vic2FtcGxlPTEKKQpkdW1WIDwtIGR1bW15VmFycyhmb3JtdWxhID0gU3Vydml2ZWR+LixkYXRhID0gdHJhaW4uaW1wKQpEdHJhaW4gPC0gcHJlZGljdChkdW1WLHRyYWluLmltcCkKc2V0LnNlZWQoMSkKeGdiZG93bkZpdCA8LSB0cmFpbigKICAgIHg9RHRyYWluLAogICAgeT10cmFpbi5pbXAkU3Vydml2ZWQsCiAgICBtZXRob2QgPSAneGdiVHJlZScsCiAgICB0ckNvbnRyb2wgPSBjdHJsLAogICAgIyBtZXRyaWMgPSAiS2FwcGEiLAogICAgdHVuZUdyaWQgPSB4Z2JHcmlkLAogICAgdmVyYm9zZSA9IFRSVUUKKQp4Z2Jkb3duRml0CnBsb3QoeGdiZG93bkZpdCkKeGdiLmltcG9ydGFuY2UoZmVhdHVyZV9uYW1lcyA9IGNvbG5hbWVzKER0cmFpbiksbW9kZWwgPSB4Z2Jkb3duRml0JGZpbmFsTW9kZWwpCnhnYi5pbXBvcnRhbmNlKGZlYXR1cmVfbmFtZXMgPSBjb2xuYW1lcyhEdHJhaW4pLG1vZGVsID0geGdiZG93bkZpdCRmaW5hbE1vZGVsKSAlPiUKeGdiLmdncGxvdC5pbXBvcnRhbmNlKCkKCmRlbnNpdHlwbG90KHhnYmRvd25GaXQscGNoPSd8JykKcHJlZGljdCh4Z2Jkb3duRml0LHR5cGUgPSAncmF3JykgLT4gdHJhaW4uQ2xhc3MKcHJlZGljdCh4Z2Jkb3duRml0LHR5cGUgPSAncHJvYicpIC0+IHRyYWluLlByb2JzCmhpc3RvZ3JhbSh+U3Vydml2ZWQrRGVhZCx0cmFpbi5Qcm9icykKYGBgCgojIyBHcmFkaWVudCBCb29zdGluZyAoZ2JtKQoKYGBge3J9CmN0cmwgPC0gdHJhaW5Db250cm9sKG1ldGhvZCA9ICJyZXBlYXRlZGN2IiwKICAgICAgICAgICAgICAgICAgICAgcmVwZWF0cyA9IDUsCiAgICAgICAgICAgICAgICAgICAgIHZlcmJvc2VJdGVyID0gVCwKICAgICAgICAgICAgICAgICAgICAgY2xhc3NQcm9icyA9IFRSVUUsCiAgICAgICAgICAgICAgICAgICAgIHN1bW1hcnlGdW5jdGlvbiA9IHR3b0NsYXNzU3VtbWFyeSwKICAgICAgICAgICAgICAgICAgICAgYWRhcHRpdmUgPSBsaXN0KG1pbiA9IDUsIGFscGhhID0gMC4wNSwgCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBtZXRob2QgPSAiZ2xzIiwgY29tcGxldGUgPSBUUlVFKSwKICAgICAgICAgICAgICAgICAgICAgc2VhcmNoID0gJ3JhbmRvbScKICAgICAgICAgICAgICAgICAgICAgKQpnYm1HcmlkIDwtIGV4cGFuZC5ncmlkKAogICBuLnRyZWVzPWMoNTAwLDcwMCw5MDAsMTEwMCksCiAgIGludGVyYWN0aW9uLmRlcHRoPWMoMSwyLDMpLAogICBzaHJpbmthZ2U9YygwLjEsMC4wMSksCiAgIG4ubWlub2JzaW5ub2RlPTEwCikKZHVtViA8LSBkdW1teVZhcnMoZm9ybXVsYSA9IFN1cnZpdmVkfi4sZGF0YSA9IHRyYWluLmltcCkKRHRyYWluIDwtIHByZWRpY3QoZHVtVix0cmFpbi5pbXApCnNldC5zZWVkKDEpCmJvb3N0Rml0IDwtIHRyYWluKAogICAgeCA9IER0cmFpbiwKICAgIHkgPSBib29zdC50cmFpbiRTdXJ2aXZlZCwKICAgIHRyQ29udHJvbD1jdHJsLAogICAgbWV0aG9kPSdnYm0nLAogICAgdHVuZUdyaWQ9Z2JtR3JpZAopCmJvb3N0Rml0CnBsb3QoYm9vc3RGaXQpCnh5cGxvdChvb2JhZy5pbXByb3ZlfjE6MTEwMCxkYXRhPWJvb3N0Rml0JGZpbmFsTW9kZWwsYWxwaGE9LjUseGxhYiA9ICduLnRyZWVzJykKcGxvdCh2YXJJbXAoYm9vc3RGaXQpKQpkZW5zaXR5cGxvdChib29zdEZpdCxwY2g9J3wnKQpwcmVkaWN0KGJvb3N0Rml0LHR5cGUgPSAncHJvYicpIC0+IHRyYWluLlByb2JzCmhpc3RvZ3JhbSh+U3Vydml2ZWQrRGVhZCx0cmFpbi5Qcm9icykKYGBgCgojIyBSYW5kb20gRm9yZXN0IChjdXN0b20gcmYpCmBgYHtyfQoKY3VzdG9tUkYgPC0KICAgIGxpc3QodHlwZSA9ICJDbGFzc2lmaWNhdGlvbiIsCiAgICBsaWJyYXJ5ID0gInJhbmRvbUZvcmVzdCIsCiAgICBsb29wID0gTlVMTCkKCmN1c3RvbVJGJHBhcmFtZXRlcnMgPC0gZGF0YS5mcmFtZSgKICAgIHBhcmFtZXRlciA9IGMoIm10cnkiLCAibnRyZWUiLCAnbm9kZXNpemUnLCAncmVwbGFjZScpLAogICAgY2xhc3MgPSBjKCJudW1lcmljIiwgJ251bWVyaWMnLCAnbnVtZXJpYycsICdsb2dpY2FsJyksCiAgICBsYWJlbCA9IGMoIm10cnkiLCAibnRyZWUiLCAnbm9kZXNpemUnLCAncmVwbGFjZScpCiAgICApCmN1c3RvbVJGJGdyaWQgPC0gZnVuY3Rpb24oeCwgeSwgbGVuID0gTlVMTCwgc2VhcmNoID0gImdyaWQiKSB7fQoKY3VzdG9tUkYkZml0IDwtCiAgICBmdW5jdGlvbih4LAogICAgeSwKICAgIHd0cywKICAgIHBhcmFtLAogICAgbGV2LAogICAgbGFzdCwKICAgIHdlaWdodHMsCiAgICBjbGFzc1Byb2JzLAogICAgLi4uKSB7CiAgICByYW5kb21Gb3Jlc3QoCiAgICB4LAogICAgeSwKICAgIG10cnkgPSBwYXJhbSRtdHJ5LAogICAgbnRyZWUgPSBwYXJhbSRudHJlZSwKICAgIHJlcGxhY2UgPSBwYXJhbSRyZXBsYWNlLAogICAgIyBjbGFzc3d0ID0gcGFyYW0kY2xhc3N3dCwKICAgIG5vZGVzaXplID0gcGFyYW0kbm9kZXNpemUKICAgICkKICAgIH0KY3VzdG9tUkYkcHJlZGljdCA8LQogICAgZnVuY3Rpb24obW9kZWxGaXQsCiAgICBuZXdkYXRhLAogICAgcHJlUHJvYyA9IE5VTEwsCiAgICBzdWJtb2RlbHMgPSBOVUxMKQogICAgcHJlZGljdChtb2RlbEZpdCwgbmV3ZGF0YSkKCmN1c3RvbVJGJHByb2IgPC0KICAgIGZ1bmN0aW9uKG1vZGVsRml0LAogICAgbmV3ZGF0YSwKICAgIHByZVByb2MgPSBOVUxMLAogICAgc3VibW9kZWxzID0gTlVMTCkKICAgICAgICBwcmVkaWN0KG1vZGVsRml0LCBuZXdkYXRhLCB0eXBlID0gInByb2IiKQpjdXN0b21SRiRzb3J0IDwtIGZ1bmN0aW9uKHgpCiAgICB4W29yZGVyKHhbLCAxXSksIF0KCmN1c3RvbVJGJGxldmVscyA8LSBmdW5jdGlvbih4KQogICAgeCRjbGFzc2VzCgpjdXN0b21SRgogICAgCiAgICAKY3RybCA8LSB0cmFpbkNvbnRyb2woCiAgICBtZXRob2QgPSAicmVwZWF0ZWRjdiIsCiAgICByZXBlYXRzID0gNSwKICAgIHZlcmJvc2VJdGVyID0gVCwKICAgIGNsYXNzUHJvYnMgPSBUUlVFLAogICAgc3VtbWFyeUZ1bmN0aW9uID0gdHdvQ2xhc3NTdW1tYXJ5LAogICAgIyBzYW1wbGluZyA9ICdzbW90ZScKKQpjcmZHcmlkIDwtIGV4cGFuZC5ncmlkKAogICAgbXRyeSA9IGMoMTAsIDE1LCAyMCwgMjkpLAogICAgbnRyZWUgPSBjKDEwMCwgMzAwLCA1MDApLAogICAgbm9kZXNpemUgPSBjKDEsIDUsIDEwKSwKICAgIHJlcGxhY2UgPSBjKFQsIEYpCiAgICAjIGNsYXNzd3QgPSBjKDAuNiwgMC44KQopCnNldC5zZWVkKDEpCmNyZkZpdCA8LSB0cmFpbigKICAgIGZvcm0gPSBTdXJ2aXZlZCB+IC4sCiAgICBkYXRhID0gdHJhaW4uaW1wLAogICAgbWV0aG9kID0gY3VzdG9tUkYsCiAgICB0ckNvbnRyb2wgPSBhZGFwdF9jdHJsLAogICAgIyBtZXRyaWMgPSAiS2FwcGEiLAogICAgdHVuZUdyaWQgPSBjcmZHcmlkLAogICAgdmVyYm9zZSA9IFRSVUUsCiAgICBjbGFzc3d0ID0gYygwLjM4LCAwLjYxKQopCmNyZkZpdF9jbGFzcyA8LSB0cmFpbigKICAgIGZvcm0gPSBTdXJ2aXZlZCB+IC4sCiAgICBkYXRhID0gdHJhaW4uaW1wLAogICAgbWV0aG9kID0gY3VzdG9tUkYsCiAgICB0ckNvbnRyb2wgPSBhZGFwdF9jdHJsLAogICAgIyBtZXRyaWMgPSAiS2FwcGEiLAogICAgdHVuZUdyaWQgPSBjcmZHcmlkLAogICAgdmVyYm9zZSA9IFRSVUUsCiAgICBjbGFzc3d0ID0gYygwLjM4LCAwLjYxKQopCiAgICAKYGBgCgojIyBDb25kaXRpb25hbCBGb3Jlc3QgKGN0cmVlKQpgYGB7cn0KY3RybCA8LSB0cmFpbkNvbnRyb2wobWV0aG9kID0gInJlcGVhdGVkY3YiLAogICAgICAgICAgICAgICAgICAgICByZXBlYXRzID0gNSwKICAgICAgICAgICAgICAgICAgICAgdmVyYm9zZUl0ZXIgPSBULAogICAgICAgICAgICAgICAgICAgICBjbGFzc1Byb2JzID0gVFJVRSwKICAgICAgICAgICAgICAgICAgICAgc3VtbWFyeUZ1bmN0aW9uID0gdHdvQ2xhc3NTdW1tYXJ5CiAgICAgICAgICAgICAgICAgICAgICMgc2FtcGxpbmcgPSAnc21vdGUnCiAgICAgICAgICAgICAgICAgICAgICkKCmNmb3Jlc3RHcmlkIDwtIGV4cGFuZC5ncmlkKG10cnk9YygxMCwyMCwzMCw0MCkpCnNldC5zZWVkKDEpCmNmb3Jlc3RGaXQgPC0gdHJhaW4oCiAgICBmb3JtID0gU3Vydml2ZWR+LiwKICAgIGRhdGEgPSB0cmFpbi5pbXAsCiAgICBtZXRob2QgPSAnY2ZvcmVzdCcsCiAgICB0ckNvbnRyb2wgPSBjdHJsLAogICAgdHVuZUdyaWQgPSBjZm9yZXN0R3JpZAogICAgIyB2ZXJib3NlID0gVFJVRQogICAgIyBudHJlZSA9IDQwMAopCmNmb3Jlc3RGaXQKcGxvdChjZm9yZXN0Rml0KQpkZW5zaXR5cGxvdChjZm9yZXN0Rml0LHBjaD0nfCcpCnByZWRpY3QoY2ZvcmVzdEZpdCx0eXBlID0gJ3Byb2InKSAtPiB0cmFpbi5jcmYuUHJvYnMKaGlzdG9ncmFtKH5TdXJ2aXZlZCtEZWFkLHRyYWluLmNyZi5Qcm9icykKYGBgCgojIyBSYW5kb20gRm9yZXN0IChyZikKYGBge3J9CmFkYXB0X2N0cmwgPC0gdHJhaW5Db250cm9sKG1ldGhvZCA9ICJyZXBlYXRlZGN2IiwKICAgICAgICAgICAgICAgICAgICAgcmVwZWF0cyA9IDUsCiAgICAgICAgICAgICAgICAgICAgIHZlcmJvc2VJdGVyID0gVCwKICAgICAgICAgICAgICAgICAgICAgY2xhc3NQcm9icyA9IFRSVUUsCiAgICAgICAgICAgICAgICAgICAgIHN1bW1hcnlGdW5jdGlvbiA9IHR3b0NsYXNzU3VtbWFyeSwKICAgICAgICAgICAgICAgICAgICAgYWRhcHRpdmUgPSBsaXN0KG1pbiA9IDUsIGFscGhhID0gMC4wNSwgCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIG1ldGhvZCA9ICJnbHMiLCBjb21wbGV0ZSA9IFRSVUUpLAogICAgICAgICAgICAgICAgICAgICBzZWFyY2ggPSAncmFuZG9tJwogICAgICAgICAgICAgICAgICAgICApCgpyZkdyaWQgPC0gZXhwYW5kLmdyaWQobXRyeT1jKDUsMTAsMTUsMjAsMjUpKQpzZXQuc2VlZCgxKQpyZkZpdC55IDwtIHRyYWluKAogICAgZm9ybSA9IFN1cnZpdmVkfi4sCiAgICBkYXRhID0gdHJhaW4uaW1wLAogICAgbWV0aG9kID0gJ3JmJywKICAgIHRyQ29udHJvbCA9IGFkYXB0X2N0cmwsCiAgICB0dW5lR3JpZCA9IHJmR3JpZCwKICAgIHZlcmJvc2UgPSBUUlVFLAogICAgbnRyZWUgPSA0MDAKKQpyZkZpdC55CnBsb3QocmZGaXQueSkKcGxvdChyZkZpdC55JGZpbmFsTW9kZWwpCmRlbnNpdHlwbG90KHJmRml0LnkscGNoPSd8JykKcHJlZGljdChyZkZpdC55LHR5cGUgPSAncHJvYicpIC0+IHRyYWluLnJmLlByb2JzCmhpc3RvZ3JhbSh+U3Vydml2ZWQrRGVhZCx0cmFpbi5yZi5Qcm9icykKYGBgCgojIyBSYW5kb20gRm9yZXN0IChyZikgLSBTTU9URQoKYGBge3J9CmN0cmwgPC0gdHJhaW5Db250cm9sKG1ldGhvZCA9ICJyZXBlYXRlZGN2IiwKICAgICAgICAgICAgICAgICAgICAgcmVwZWF0cyA9IDUsCiAgICAgICAgICAgICAgICAgICAgIHZlcmJvc2VJdGVyID0gVCwKICAgICAgICAgICAgICAgICAgICAgY2xhc3NQcm9icyA9IFRSVUUsCiAgICAgICAgICAgICAgICAgICAgIHN1bW1hcnlGdW5jdGlvbiA9IHR3b0NsYXNzU3VtbWFyeSwKICAgICAgICAgICAgICAgICAgICAgc2FtcGxpbmcgPSAnc21vdGUnCiAgICAgICAgICAgICAgICAgICAgICkKCnJmR3JpZCA8LSBleHBhbmQuZ3JpZChtdHJ5PWMoNSwxMCwxNSwyMCwyNSkpCnNldC5zZWVkKDEpCnJmc21vdGVGaXQueSA8LSB0cmFpbigKICAgIGZvcm0gPSBTdXJ2aXZlZH4uLAogICAgZGF0YSA9IHRyYWluLmltcCwKICAgIG1ldGhvZCA9ICdyZicsCiAgICB0ckNvbnRyb2wgPSBjdHJsLAogICAgIyBtZXRyaWMgPSAiS2FwcGEiLAogICAgdHVuZUdyaWQgPSByZkdyaWQsCiAgICB2ZXJib3NlID0gVFJVRSwKICAgIG50cmVlID0gNDAwCikKcmZzbW90ZUZpdC55CnBsb3QocmZzbW90ZUZpdC55KQpwbG90KHJmc21vdGVGaXQueSRmaW5hbE1vZGVsKQpkZW5zaXR5cGxvdChyZnNtb3RlRml0LnkscGNoPSd8JykKcHJlZGljdChyZnNtb3RlRml0LnksdHlwZSA9ICdwcm9iJykgLT4gdHJhaW4ucmZzbW90ZUZpdC5Qcm9icwpoaXN0b2dyYW0oflN1cnZpdmVkK0RlYWQsdHJhaW4ucmZzbW90ZUZpdC5Qcm9icykKYGBgCgojIyBFbGFzdGluZXQKCmBgYHtyfQpjdHJsIDwtIHRyYWluQ29udHJvbChtZXRob2QgPSAicmVwZWF0ZWRjdiIsCiAgICAgICAgICAgICAgICAgICAgIHJlcGVhdHMgPSA1LAogICAgICAgICAgICAgICAgICAgICB2ZXJib3NlSXRlciA9IFQsCiAgICAgICAgICAgICAgICAgICAgIGNsYXNzUHJvYnMgPSBUUlVFLAogICAgICAgICAgICAgICAgICAgICBzdW1tYXJ5RnVuY3Rpb24gPSB0d29DbGFzc1N1bW1hcnksCiAgICAgICAgICAgICAgICAgICAgIHNhbXBsaW5nID0gJ3Ntb3RlJwogICAgICAgICAgICAgICAgICAgICApCmdsbW5ldEdyaWQgPC0gZXhwYW5kLmdyaWQoLmFscGhhID0gYygwLC4xLC4yLC40LC42LC44LDEpLAogICAgICAgICAgICAgICAgICAgICAgICAgIC5sYW1iZGEgPSBzZXEoMC4wMSwwLjIsbGVuZ3RoLm91dCA9IDQwKSkKc2V0LnNlZWQoMSkKZHVtViA8LSBkdW1teVZhcnMoZm9ybXVsYSA9IFN1cnZpdmVkfi4sZGF0YSA9IHRyYWluLmltcCkKRHRyYWluIDwtIHByZWRpY3QoZHVtVix0cmFpbi5pbXApCmdsbW5ldEZpdCA8LSB0cmFpbigKICAgIHggPSBEdHJhaW4sCiAgICB5ID0gdHJhaW4uaW1wJFN1cnZpdmVkLAogICAgdHJDb250cm9sPWN0cmwsCiAgICBtZXRob2Q9J2dsbW5ldCcsCiAgICB0dW5lR3JpZD1nbG1uZXRHcmlkCikKZ2xtbmV0Rml0CnBsb3QoZ2xtbmV0Rml0LHBsb3RUeXBlPSdsZXZlbCcpCnBsb3QodmFySW1wKGdsbW5ldEZpdCkpCmRlbnNpdHlwbG90KGdsbW5ldEZpdCxwY2g9J3wnKQpwcmVkaWN0KGdsbW5ldEZpdCx0eXBlID0gJ3Byb2InKSAtPiB0cmFpbi5nbG1uZXQuUHJvYnMKaGlzdG9ncmFtKH5TdXJ2aXZlZCtEZWFkLHRyYWluLmdsbW5ldC5Qcm9icykKCmBgYAoKCiMgQ29tcGFyZSBtb2RlbHMKYGBge3J9CnJlIDwtCiAgICByZXNhbXBsZXMoCiAgICB4ID0gbGlzdCgKICAgIHhnYiA9IHhnYkZpdCwKICAgIHhnYnNtb3RlID0geGdic21vdGVGaXQsCiAgICB4Z2Jkb3duID0geGdiZG93bkZpdCwKICAgIHJmID0gcmZGaXQueSwKICAgIHJmc21vdGUgPSByZnNtb3RlRml0LnksCiAgICBnYm0gPSBib29zdEZpdCwKICAgIGVsYXN0aW5ldD1nbG1uZXRGaXQsCiAgICBjcmYgPSBjcmZGaXQsCiAgICBjcmZGaXRfY2xhc3M9IGNyZkZpdF9jbGFzcywKICAgIHhnYnNtYWxsPXhnYnNtYWxsRml0LAogICAgY2ZvcmVzdD1jZm9yZXN0Rml0CiAgICApCiAgICApCiMgc3VtbWFyeShyZSkKYndwbG90KHJlKQpkb3RwbG90KHJlKQojIHN1bW1hcnkoZGlmZihyZSkpCmBgYAoKIyMgQ2FsaWJyYXRpb24gY3VydmVzLi4uCmBgYHtyfQpzaW11bGF0ZWRUcmFpbiA8LSBkYXRhLmZyYW1lKENsYXNzID0gdHJhaW4uaW1wJFN1cnZpdmVkKQpzaW11bGF0ZWRUcmFpbiRyZiA9IHByZWRpY3QocmZGaXQueSx0eXBlID0gJ3Byb2InKVtbMV1dCnNpbXVsYXRlZFRyYWluJHJmc21vdGUgPSBwcmVkaWN0KHJmc21vdGVGaXQueSx0eXBlID0gJ3Byb2InKVtbMV1dCnNpbXVsYXRlZFRyYWluJHhnYiA9IHByZWRpY3QoeGdiRml0LHR5cGUgPSAncHJvYicpW1sxXV0Kc2ltdWxhdGVkVHJhaW4keGdic21vdGUgPSBwcmVkaWN0KHhnYnNtb3RlRml0LHR5cGUgPSAncHJvYicpW1sxXV0Kc2ltdWxhdGVkVHJhaW4kYm9vc3QgPSBwcmVkaWN0KGJvb3N0Rml0LHR5cGUgPSAncHJvYicpW1sxXV0KYGBgCmBgYHtyfQpjYWxDdXJ2ZSA8LSBjYWxpYnJhdGlvbih4ID0gQ2xhc3N+cmYrcmZzbW90ZSt4Z2IreGdic21vdGUrYm9vc3QsZGF0YSA9IHNpbXVsYXRlZFRyYWluKQp4eXBsb3QoY2FsQ3VydmUsYXV0by5rZXk9bGlzdChjb2x1bW5zPTMpKQpgYGAKCiMgQ2FsaWJyYXRpbmcgcHJvYmFiaWxpdGllcwoKYGBge3J9CmJvb3N0c2lnbW9pZENhbCA8LSBnbG0ocmVsZXZlbChDbGFzcyxyZWY9J0RlYWQnKX5ib29zdCxzaW11bGF0ZWRUcmFpbixmYW1pbHkgPSAnYmlub21pYWwnKQpjb2VmKHN1bW1hcnkoYm9vc3RzaWdtb2lkQ2FsKSkKc2ltdWxhdGVkVHJhaW4kYm9vc3RTaWcgPSBwcmVkaWN0KGJvb3N0c2lnbW9pZENhbCx0eXBlID0gJ3Jlc3BvbnNlJykKCnhnYnNtb3Rlc2lnbW9pZENhbCA8LSBnbG0ocmVsZXZlbChDbGFzcyxyZWY9J0RlYWQnKX54Z2JzbW90ZSxzaW11bGF0ZWRUcmFpbixmYW1pbHkgPSAnYmlub21pYWwnKQpjb2VmKHN1bW1hcnkoeGdic21vdGVzaWdtb2lkQ2FsKSkKc2ltdWxhdGVkVHJhaW4keGdic21vdGVTaWcgPSBwcmVkaWN0KHhnYnNtb3Rlc2lnbW9pZENhbCx0eXBlID0gJ3Jlc3BvbnNlJykKCmNhbGlicmF0aW9uKHggPSBDbGFzc35ib29zdCtib29zdFNpZyxkYXRhID0gc2ltdWxhdGVkVHJhaW4pICU+JQogICAgeHlwbG90KGF1dG8ua2V5PWxpc3QoY29sdW1ucz0yKSkKY2FsaWJyYXRpb24oeCA9IENsYXNzfnhnYnNtb3RlK3hnYnNtb3RlU2lnLGRhdGEgPSBzaW11bGF0ZWRUcmFpbikgJT4lCiAgICB4eXBsb3QoYXV0by5rZXk9bGlzdChjb2x1bW5zPTIpKQpgYGAKCgojIFRlc3QgU2V0IEV2YWx1YXRpb24KIyMgQ3JlYXRlIHRlc3Qgc2V0CmBgYHtyfQp0ZXN0LmltcCA8LSB0ZXN0LnJhdwoKI0VtYmFya2VkCnRlc3QuaW1wJEVtYmFya2VkW2lzLm5hKHRlc3QuaW1wJEVtYmFya2VkKV09J1MnCgojVGl0bGUKdGVzdC5yYXckdGl0bGUgPC0gc3RyX2V4dHJhY3QocGF0dGVybiA9ICdbYS16QS1aXSsoPz1cXC4pJyxzdHJpbmcgPSB0ZXN0LnJhdyROYW1lKQojdGVzdC5yYXckdGl0bGUgPC0gYXMuZmFjdG9yKHRlc3QucmF3JHRpdGxlKQp0ZXN0LmltcCR0aXRsZSA8LSBhcy5jaGFyYWN0ZXIodGVzdC5yYXckdGl0bGUpCnRlc3QuaW1wJHRpdGxlW3Rlc3QuaW1wJHRpdGxlICVpbiUgYygnQ29sJywnTWFqb3InKV0gPC0gJ09mZmljZXInCnRlc3QuaW1wJHRpdGxlW3Rlc3QuaW1wJHRpdGxlICVpbiUgYygnRG9uJywnRHInLCdSZXYnLCdTaXInLCdKb25raGVlcicsJ0NvdW50ZXNzJywnTGFkeScsJ0RvbmEnKV0gPC0gJ1JveWFsdHknCnRlc3QuaW1wJHRpdGxlW3Rlc3QuaW1wJHRpdGxlICVpbiUgYygnTXJzJywnTW1lJyldIDwtICdNcnMnCnRlc3QuaW1wJHRpdGxlW3Rlc3QuaW1wJHRpdGxlICVpbiUgYygnTXMnLCdNbGxlJyldIDwtICdNaXNzJwp0ZXN0LmltcCR0aXRsZSA8LSBhcy5mYWN0b3IodGVzdC5pbXAkdGl0bGUpCgojTWlzc2luZyBhZ2UKbWlzc2luZy5hZ2UgPC0gdGVzdC5pbXAgJT4lIGZpbHRlcihpcy5uYShBZ2UpKQphZ2UucHJlZGljdGVkIDwtIHByZWRpY3QocmZGaXQsIG5ld2RhdGEgPSBtaXNzaW5nLmFnZSkKdGVzdC5pbXAkQWdlW2lzLm5hKHRlc3QuaW1wJEFnZSldIDwtIGFnZS5wcmVkaWN0ZWQKdGVzdC5pbXAkQWdlW3Rlc3QuaW1wJHRpdGxlPT0nTWFzdGVyJyAmIHRlc3QuaW1wJEFnZSA+IDIwXSA8LSA0CgojQ2hpbGQKdGVzdC5pbXAkY2hpbGQgPC0gMAp0ZXN0LmltcCRjaGlsZFt0ZXN0LmltcCRBZ2U8MThdIDwtIDEKdGVzdC5pbXAkYWxtb3N0YWR1bHQgPC0gYXMubnVtZXJpYyhiZXR3ZWVuKHRlc3QuaW1wJEFnZSwxNiwxOCkpCgojWW91bmcvb2xkCnRlc3QuaW1wJFlvdW5nIDwtIGlmZWxzZSh0ZXN0LmltcCRBZ2U8MTAsMSwwKQp0ZXN0LmltcCRTZW5pb3JzIDwtIGlmZWxzZSh0ZXN0LmltcCRBZ2U+NjAsMSwwKQoKI0ZhbWlseSBSZWxhdGVkCnRlc3QuaW1wJFRvdGFsRmFtIDwtIHRlc3QuaW1wJFNpYlNwICsgdGVzdC5pbXAkUGFyY2ggKyAxCnRlc3QuaW1wJE5hbWUgPC0gTlVMTAp0ZXN0LmltcCRMYXJnZVBhckNoIDwtIGFzLm51bWVyaWModGVzdC5pbXAkUGFyY2g+PTMpCnRlc3QuaW1wJExhcmdlU2liU3AgPC0gYXMubnVtZXJpYyh0ZXN0LmltcCRTaWJTcD49MykKdGVzdC5pbXAkU2luZ2xlIDwtIGlmZWxzZSh0ZXN0LmltcCRUb3RhbEZhbT09MSwxLDApCnRlc3QuaW1wJENvdXBsZSA8LSBpZmVsc2UodGVzdC5pbXAkVG90YWxGYW09PTIsMSwwKQp0ZXN0LmltcCRGYW1pbHkgPC0gaWZlbHNlKHRlc3QuaW1wJFRvdGFsRmFtPjQsMSwwKQoKI0NhYmluICYgRGVjawp0ZXN0LmltcCRDYWJpbk1pc3NpbmcgPC0gYXMubnVtZXJpYyhpcy5uYSh0ZXN0LnJhdyRDYWJpbikpCnRlc3QuaW1wJENhYmluQ29kZSA8LSBtYXBfY2hyKHRlc3QucmF3JENhYmluLH5zdHJfc3BsaXQoc3RyaW5nID0gLngscGF0dGVybiA9ICcnKVtbMV1dWzFdKQp0ZXN0LmltcCRDYWJpbkNvZGVbaXMubmEodGVzdC5pbXAkQ2FiaW5Db2RlKV0gPC0gJ1UnCnRlc3QuaW1wJENhYmluTnVtIDwtIGFzLm51bWVyaWMobWFwX2Nocih0ZXN0LnJhdyRDYWJpbix+c3RyX3NwbGl0KHN0cmluZyA9IC54LHBhdHRlcm4gPSAnW2EtekEtWl0nKVtbMV1dWzJdKSkKdGVzdC5pbXAkQ2FiaW5OdW0gPC0gbWFwX2ludCh0ZXN0LmltcCRDYWJpbk51bSwgfmFzLmludGVnZXIoc3RyX3NwbGl0KC54LHBhdHRlcm4gPSAnJyxzaW1wbGlmeSA9IFQpWzFdWzFdKSkKdGVzdC5pbXAkQ2FiaW5OdW1baXMubmEodGVzdC5pbXAkQ2FiaW5OdW0pXSA8LSAwCgp0ZXN0LmltcCRDYWJpbkNvZGUgPC0gZmFjdG9yKAogICAgeCA9IHRlc3QuaW1wJENhYmluQ29kZSwKICAgIGxldmVscyA9IHVuaXF1ZSh0cmFpbi5pbXAkQ2FiaW5Db2RlKQopCgp0ZXN0LmltcCRUb3BEZWNrIDwtIGlmZWxzZSh0ZXN0LmltcCRDYWJpbkNvZGUgJWluJSBjKCdBJywnQicpLDEsMCkKdGVzdC5pbXAkTWlkRGVjayA8LSBpZmVsc2UodGVzdC5pbXAkQ2FiaW5Db2RlICVpbiUgYygnQycsJ0QnKSwxLDApCnRlc3QuaW1wJExvd2VyRGVjayA8LSBpZmVsc2UodGVzdC5pbXAkVG9wRGVjaz09MCAmIHRlc3QuaW1wJE1pZERlY2sgPT0wICwxLDApCgp0ZXN0LmltcCROdW1iZXJvZkNhYmlucyA8LSBtYXBfaW50KHRlc3QucmF3JENhYmluLH5zdHJfc3BsaXQoc3RyaW5nID0gLngscGF0dGVybiA9ICcgJylbWzFdXSAlPiUgbGVuZ3RoKQp0ZXN0LmltcCRDYWJpbiA8LSBOVUxMCgoKIyBUaWNrZXQKdGVzdC5pbXAgJTw+JQogICAgbXV0YXRlKAogICAgICBUaWNrZXQgPSBzdHJfdG9fdXBwZXIoVGlja2V0KSAlPiUKICAgICAgICAgIHN0cl9yZXBsYWNlX2FsbChwYXR0ZXJuID0gcmVnZXgocGF0dGVybiA9ICdbLlxcL10nKSxyZXBsYWNlbWVudCA9ICcnKSwKICAgICAgVGlja2V0TnVtID0gc3RyX2V4dHJhY3QoVGlja2V0LHBhdHRlcm4gPSByZWdleCgnKFswLTldKXszLH0nKSksCiAgICAgIFRpY2tldE51bVN0YXJ0ID0gbWFwX2ludChUaWNrZXROdW0sfmFzLmludGVnZXIoc3RyX3NwbGl0KC54LHBhdHRlcm4gPSAnJyxzaW1wbGlmeSA9IFQpWzFdKSksCiAgICAgIFRpY2tldE51bUxlbiA9IG1hcF9pbnQoVGlja2V0TnVtLH5kaW0oc3RyX3NwbGl0KC54LHBhdHRlcm4gPSAnJyxzaW1wbGlmeSA9IFQpKVsyXSksCiAgICAgIFRpY2tldENoYXIgPSBzdHJfZXh0cmFjdChUaWNrZXQscGF0dGVybiA9IHJlZ2V4KCdeW2EtekEtWi9cXC5dKycpKQogICAgICApICU+JQogICAgbXV0YXRlKAogICAgICAgIFRpY2tldENoYXIgPSBtYXBfY2hyKC54PVRpY2tldENoYXIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgLmY9fnN0cl9zcGxpdChzdHJpbmc9LngsIHBhdHRlcm4gPSAnJyxzaW1wbGlmeSA9IFQpWzFdKQogICAgICAgICkgJT4lICAKICAgIG11dGF0ZSgKICAgICAgVGlja2V0Q2hhciA9IGlmZWxzZShpcy5uYShUaWNrZXRDaGFyKSwnVScsVGlja2V0Q2hhciksCiAgICAgIFRpY2tldE51bVN0YXJ0ID0gaWZlbHNlKGlzLm5hKFRpY2tldE51bVN0YXJ0KSwwLFRpY2tldE51bVN0YXJ0KSwKICAgICAgVGlja2V0TnVtTGVuID0gaWZlbHNlKGlzLm5hKFRpY2tldE51bUxlbiksMCxUaWNrZXROdW1MZW4pLAogICAgKQp0ZXN0LmltcCRUaWNrZXQgPC0gTlVMTAp0ZXN0LmltcCRUaWNrZXROdW0gPC0gTlVMTAoKI0ZhcmUKdGVzdC5pbXAkRmFyZVtpcy5uYSh0ZXN0LmltcCRGYXJlKV0gPC0gMTQuNDU0MgojIHRlc3QuaW1wJEZhcmVbdGVzdC5pbXAkRmFyZT4yMzJdIDwtIDIzMgoKYGBgCiMjIFByZWRpY3QgdGVzdCByZXN1bHRzCmBgYHtyfQpkdW1WIDwtIGR1bW15VmFycyhmb3JtdWxhID0gfi4sZGF0YSA9IHRlc3QuaW1wKQpEdGVzdCA8LSBwcmVkaWN0KGR1bVYsdGVzdC5pbXApCgpib29zdFByZWQgPC0gaWZlbHNlKHByZWRpY3QoYm9vc3RGaXQkZmluYWxNb2RlbCxuZXdkYXRhID0gRHRlc3Qsbi50cmVlcyA9IGJvb3N0Rml0JGJlc3RUdW5lJG4udHJlZXMsdHlwZSA9ICdyZXNwb25zZScpPjAuNSwxLDIpCnhnYlByZWQgPC0gcHJlZGljdChvYmplY3QgPSB4Z2JGaXQsIG5ld2RhdGEgPSBEdGVzdCkKeGdic21vdGVQcmVkIDwtIHByZWRpY3Qob2JqZWN0ID0geGdic21vdGVGaXQsIG5ld2RhdGEgPSBEdGVzdCkKcmZQcmVkIDwtIHByZWRpY3Qob2JqZWN0ID0gcmZGaXQueSwgbmV3ZGF0YSA9IHRlc3QuaW1wKQpyZnNtb3RlUHJlZCA8LSBwcmVkaWN0KG9iamVjdCA9IHJmc21vdGVGaXQueSwgbmV3ZGF0YSA9IHRlc3QuaW1wKQoKYm9vc3RQcm9iIDwtIGRhdGEuZnJhbWUoYm9vc3Q9cHJlZGljdChib29zdEZpdCRmaW5hbE1vZGVsLG5ld2RhdGEgPSBEdGVzdCxuLnRyZWVzID0gYm9vc3RGaXQkYmVzdFR1bmUkbi50cmVlcyx0eXBlID0gJ3Jlc3BvbnNlJykpCmJvb3N0U2lnUHJlZCA8LSBwcmVkaWN0KG9iamVjdCA9IGJvb3N0c2lnbW9pZENhbCxuZXdkYXRhID0gYm9vc3RQcm9iLHR5cGUgPSAncmVzcG9uc2UnKQpib29zdFNpZ1ByZWQgPC0gaWZlbHNlKGJvb3N0U2lnUHJlZD49MC41LDEsMikKCnhnYnNtb3Rlc2lnbW9pZENhbAp4Z2JQcm9iIDwtIGRhdGEuZnJhbWUoeGdic21vdGU9cHJlZGljdChvYmplY3QgPSB4Z2JzbW90ZUZpdCwgbmV3ZGF0YSA9IER0ZXN0LHR5cGUgPSAncHJvYicpW1sxXV0pCnhnYnNtb3RlU2lnUHJlZCA8LSBwcmVkaWN0KG9iamVjdCA9IHhnYnNtb3Rlc2lnbW9pZENhbCxuZXdkYXRhID0geGdiUHJvYix0eXBlID0gJ3Jlc3BvbnNlJykKeGdic21vdGVTaWdQcmVkIDwtIGlmZWxzZSh4Z2JzbW90ZVNpZ1ByZWQ+MC41LDEsMikKCgpjcmZQcmVkIDwtIHByZWRpY3QoY3JmRml0LG5ld2RhdGEgPSB0ZXN0LmltcCkKY3JmQ2xhc3NQcmVkIDwtIHByZWRpY3QoY3JmRml0X2NsYXNzLG5ld2RhdGEgPSB0ZXN0LmltcCkKCnhnYmRvd25QcmVkIDwtIHByZWRpY3QoeGdiZG93bkZpdCxuZXdkYXRhID0gRHRlc3QpCgpgYGAKCgpDb21iaW5lZCBkYXRhLi4uIGVuc2VtYmxlIHZvdGluZyBtb2RlbC4uLgpgYGB7cn0KZCA8LSBkYXRhLmZyYW1lKGJvb3N0UHJlZCx4Z2JQcmVkLHJmUHJlZCx4Z2JzbW90ZVByZWQscmZzbW90ZVByZWQsYm9vc3RTaWdQcmVkLGNyZlByZWQsY3JmQ2xhc3NQcmVkKQptYXBfZGYoZCx+YXMubnVtZXJpYygueCkqLTErMikgLT4gZApkICU8PiUgCiAgICBtdXRhdGUoQXZnPXJvd01lYW5zKC4pLAogICAgICAgICAgIFN1bXMgPSByb3dTdW1zKC4pLAogICAgICAgICAgIEVuc2VtYmxlVm90ZSA9IGFzLm51bWVyaWMoU3Vtcz40KSkKCmVuc2VtYmxlUHJlZCA8LSAtMSooZCRFbnNlbWJsZVZvdGUtMikKYGBgCgoKCiMjIFdyaXRlIHJlc3VsdHMKYGBge3J9ClBJRCA8LQogICAgcmVhZERhdGEoVGl0YW5pYy5wYXRoLAogICAgdGVzdC5kYXRhLmZpbGUsCiAgICB0ZXN0LmNvbHVtbi50eXBlcywKICAgIG1pc3NpbmcudHlwZXMpClBJRCA8LSBQSUQkUGFzc2VuZ2VySWQKYGBgCmBgYHtyfQpmb3IobSBpbiBscyhwYXR0ZXJuID0gJ1ByZWQnKSkgewogICAgd3JpdGUuY3N2KAogICAgeCA9IGRhdGEuZnJhbWUoCiAgICBQYXNzZW5nZXJJZCA9IFBJRCwKICAgIFN1cnZpdmVkID0gYXMubnVtZXJpYyhldmFsKHBhcnNlKHRleHQgPSBtKSkpICogLTEgKyAyCiAgICApLAogICAgZmlsZSA9IHBhc3RlMChtLCcuY3N2JyksCiAgICByb3cubmFtZXMgPSBGCiAgICApCn0KYGBgCgojIENvbmNsdXNpb25zCgoKCiMgTWlzYyAtIGRlbGV0ZSBsYXRlci4uLgpgYGB7cn0KZCA8LSBkYXRhLmZyYW1lKGJvb3N0UHJlZCx4Z2JQcmVkLHJmUHJlZCx4Z2JzbW90ZVByZWQscmZzbW90ZVByZWQsYm9vc3RTaWdQcmVkLGNyZlByZWQsY3JmQ2xhc3NQcmVkKQptYXBfZGYoZCx+YXMubnVtZXJpYygueCkqLTErMikgLT4gZApkICU8PiUgCiAgICBtdXRhdGUoQXZnPXJvd01lYW5zKC4pLAogICAgICAgICAgIFN1bXMgPSByb3dTdW1zKC4pLAogICAgICAgICAgIEVuc2VtYmxlVm90ZSA9IGFzLm51bWVyaWMoU3Vtcz40KSkKCiNkICU+JSByb3duYW1lc190b19jb2x1bW4oJ3Jvd2lkJykgJT4lIHJlc2hhcGUyOjptZWx0KGlkLnZhcnM9J3Jvd2lkJykgJT4lIAojICAgIGdncGxvdChhZXMoeD1yb3dpZCwgeT12YWx1ZSkpKwojICAgIGdlb21fcG9pbnQoYWVzKGNvbD12YXJpYWJsZSkpCmBgYAoKYGBge3J9CnRyYWluLmltcCAlPiUgCiAgICBiaW5kX2NvbHMoc2ltdWxhdGVkVHJhaW4pICU+JQogICAgbXV0YXRlKFlvdW5nPWFzLmZhY3RvcihZb3VuZykpICU+JSAKICAgIGdyb3VwX2J5KFlvdW5nKSAlPiUKICAgIHN1bW1hcml6ZSgKICAgICAgICBBPW1lYW4oQWdlLG5hLnJtID0gVCksCiAgICAgICAgUz1zZChBZ2UpCiAgICApCmBgYA==